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ABSTRACT 

The cost-effect iveness and 3-year impacts of 
California's Greater Avenues for Independence (GAIN) program, which 
is a statewide initiative aimed at increasing the employment and 
self-sufficiency of recipients of Aid to Families with Dependent 
Children (AFDC) , were evaluated by studying follow-up data for 33,000 
people from 6 counties who entered GAIN between early 1988 and 
mid-1990. Sample members were randomly classified as experimentals 
(people subject to GAIN' s participation requirements) or controls 
(people precluded from the GAIN program but free to seek other 
services in the community on their own). The employment, .earnings, 
and welfare outcomes of the experimentals and controls were then 
compared. GAIN produced earnings gains and welfare savings for both 
single parents and heads of two-parent families. In their third year 
after orientation, GAIN participants' earnings were 25% higher than 
the controls' earnings. GAIN substantially increased participation in 
job search and basic education, and it reduced the proportion of 
experimentals who were on AFDC during the last quarter of year 3 by 
3*/.. gain's impacts varied by county. (Contains 30 references. A total 
of 154 tables/figures are included in the report and appendixes. Also 
appended are analyses of the survey responses and AFDC case 
closure/recidivism.) (MN) 




ill, 



ERIC 




are-to 




ram 



U S DEPARTMENT OF EDUCATION 
OKiCO oi Eoiic.il'Oi>rfi Pesoarc*' and impiovpmonl 
EDUCATIONAL RESOURCES INFORMATION 
/ CENTER (ERIC) 

An This documenl has been reproduced as 
/ received Irom Ihe peison or organization 
originating it 
□ Minor changes have boon made to 
improve roproduclton quanly 

• Points ol viGW or opinions staled in this 
documenl do not necessarily represent 
official OERI position or policy 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 




T!5 




1/ 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC).' 



Research Corpomiion 
September 1994 



^ .vv..>w: 




BOARD OF DIRECTORS 

RICHARD R NATHAN, Chairman 
Provost, Rockefeller College 
State University of New York 
Director, Rockefeller Institute 
of Government 

PAUL H. O'NEILL, Treasurer 
Chairman and CEO 
Alcoa 

EU GINZBERG, Chairvian Emeritus 
Director 

The Eisenhower Center for the 

Conservation of Human Resources 
Columbia University 



REBECCA M. BLANK 

Associate Professor of Economics 
Northwestern University 

ANTONLS. HERNANDEZ 

President and General Counsel 
Mexican American Legal Defense and 
Educational Fund 

ALANKISTLER 

President 

Human Resources Development Institute 
AFLrCIO 

RICHARD J- MURNANE 

Professor of Education 
Graduate School of Education 
Harvard University 



RUDOLPH G. PENNER 

Director of Economic Studies 
Policy Economics Group 
KPMG Peat Manvick 

FRANKLIN D. RAINES 

Vice Chairman 
Fannie Mae 

ROBERT SOLOW 

Institute Professor 

Massachusetts Institute of Technology 

GILBERT STEINER 

Senior Fellow 
Brookings Institution 

MITCHELL SVmiDOFF 

Professor Emeritus and Senior Fellow 
Community Development Research Center 
New School for Social Research 

WILUAM JUUUS WILSON 

Lucy Flower University Professor 
of Sociology and Public Policy 
The University of Chicago 

WILUAM S. WOODSIDE 

Chairman, Sky Chefs, Inc. 
Former Chairman and CEO, 
Primerica Corporation 



JUDITH M. GUERON 

President 

Manpower Demonstration Research Corporation 



3 



MDRC 



GAIN: 



Benefits f Costs ^ and 
Three-Year Impacts 
of a Welfare-to-Work 

Program 

California s Greater Avenues for Independence Program 

James Riccio 
Daniel Friedlander 
Stephen Freedman 

with 

Mary E^FarreU 
Veronica FeUerath 
StaceyFox 
Daniel J, Lehman 

Manpower Demonstration 
Research Corporation 

September 1994 

MDRC 



ERIC 



4 



The Manpower Demonstration Research Corporation's evaluation of the California Greater Ivenues 
for Independence (GAIN) Program is funded by a contract from the California Department of i^ocial 
Services (CDSS) with fundmg from CDSS and the U.S. Department of Health and Hmnan Services 
(HHS). HHS provided additional fmiding for the collection and analysis of literacy test data. In 
addition, for special analyses of employment and welfare dynamics and parts of the benefit-cost 
analysis, HHS provided resources under MDRC's contract with HHS to conduct the evaluation of 
the Job Opportunities and Basic Skills Training (JOBS) Program (Contract No. HHS-100-89- 
0030). 



Dissemination of MDRC publications is also supported by MDRC's Public Policy Outreach funders: the 
Ford Foundation, the Ambrose Monell Foundation, and the Alcoa Foundation. 



The findings and conclusions presented in this report do not necessarily represent the official positions 
or policies of the funders. 



Library of Congress Cataloging-in-Publication Data 
Riccio, James A. 

GAIN: benefits, costs, and three-year impacts of a welfare-to-work program / James 
Riccio, Daniel Friedlander, Stephen Freedman; with Mary E. Farrell, Veronica 
Fellerath, Stacey Fox, Daniel J. Lehman, 
p. cm. 

"September 1994." 

Report on California's Greater Avenues for Independence (GAIN) Program. 
Includes bibliographical references. 

1. Aid to Families with Dependent Children programs -Cahfomia -Evaluation. 2. 
Welfare recipients -Education and training programs -Cahfomia. 3. Welfare 
recipients-Employment-Califomia. I. Friedlander, Daniel, n. Freedman, Stephen, 
m. Manpower Demonstration Research Corporation. IV. Title. V. Title: Greater 
Avenues for Independence Program. 
HV699.3.C2R53 1994 

362.5*8*09794-dc20 94-21878 

CEP 



Copyright ® 1994 by the Manpower Demonstration Research Corporation 



ERLC 



ACKNOWLEDGMENTS 



This report on GAIN is the product of a long-term collaboration that began in 1986 among a 
diverse group of administrators and program staff in California and researchers at MDRC. We would 
like to express our appreciation to some of these people and to others \vhose involvement was critical 
to the success of the evaluation. 

In California's Department of Social Services (CDSS), Bruce Wagstaff, Chief of the 
Employment and Immigration Programs Branch, provided wise counsel from the inception of the 
evaluation, as did his predecessor, Kaihy Lewis. We also appreciate the support of Eloise Anderson, 
Director of CDSS, and her predecessor, Linda McMahon; Michael Genest, Deputy Director of AFDC 
Programs at CDSS; and two former deputy directors who were closely involved in the evaluation, 
Dennis Boyle and Carl Williams. A number of other CDSS staff deserve special mention for their 
^ help over the years, including Tom Burke, Maria Hernandez, Curtis Howard, Jan Howard, Kathy 

Manzer, Rafael Rodriguez, Del Sayles, and Helen T^ai. We would also like to acknowledge Jo 
Frederick, Julia Lopez, and Paul Warren, who were legislative staff of the now-expired state 
legislature's Joint Oversight Committee on GAIN, for their keen insights and support during both the 
formative and later stages of this evaluation. 

The commitment and cooperation of staff throughout the study sites was unwavering. We would 
like to thank air who contributed to the project, and especially tlie county welfare directors and the 
evaluation coordinators, along with other key staff. These include: in Alameda, Rodger G. Lum, Jo 
Mueller, and Libess Holguin; in Butte, Patricia Cragar, Jeff Fontana, and Betsy Kruger; in Los 
Angeles, Eddy Tanaka, John Martinelli, Pat Knauss, and Brenda Rosenfeld; in Riverside, Lawrence 
E. Townsend, Jr., Marilyn Kuhlman, and John Rodgers; in San Diego, Cecil H. Steppe, Ted 
Schwend, Ray Koenig, and Marilyn Stewart; and in Tulare, Arnold Fein, Katie Wallace, and Allan 
Tufts. Their help on many different parts of their evaluation, and their careful reviews of draft 
reports, are deeply appreciated. In addition, we are grateful to the many state and county staff who 
facilitated MDRC's access to and use of state and county automated records data. 

At MDRC, numerous staff played an important role in the production of this report. We would 
especially like to thank Judith Gueron, Gordon Berlin, Barbara Goldman, and John Wallace for their 
many valuable comments on earlier drafts as well as for their overall guidance in the project. David 
Long contributed important suggestions to the benefit-cost analysis. Alan Orenstein, a consultant, 
contributed to Chapter 5 and provided helpful conmients on other parts of the report. For the 
collection and processing of the county and state data, we are grateful to Karen Paget, who supervised 
the effort, and to Debra Romm, Anita Kraus, and Mohammed Amzad. Kristen Harknett assistea in 
programming the registrant survey. Venitta Barnett helped compile information for the cost analysis, 
and Stuart Yeh helped collect information on the county welfare caseloads and economic conditions. 
David Navarro and Evan Weissman performed an essential liaison role with CDSS and the counties. 
Judith Greissman edited the report and was supported by Michael Wilde, Patt Pontevolpe, Stephanie 
Cowell, and Jean Knab. 



The Authors 



ERLC 



-111- 



PREFACE 



Nine years ago, California passed major welfare reform legislation, and shortly thereafter the 
state's Department of Social Services contracted with the Manpower Demonstration Research 
Corporation to conduct a comprehensive evaluation of the newly created Greater Avenues for 
Independence (GAIN) Program. This final report is the culmination of eight years of an unusual 
collaboration between state and local officials responsible for implementing this challenging new 
initiative and researchers charged with answering questions about the feasibility, impact, cost- 
effectiveness, and relative success of different county GAIN strategies. 

Major rigorous, longitudinal studies such as this one do not just happen. They succeed because 
very busy program administrators and their staff take a risk in opening their programs to scrutiny and 
make a multi-year commitment to follow research protocols and provide data. Throughout this study, 
and despite staff turnover, people in the California Department of Social Services and the research 
counties sustained a remarkable commitment to learning about the potential of GAIN. Their 
enthusiasm, probing questions, and unflagging cooperation contributed to what has evolved into a 
landmark study. When the evaluation began, there was little guidance about the most effective way 
to implement GAIN'S innovative approach. By trying various strategies and working with MDRC to 
measure their success, the study counties provided a unique laboratory for learning. Our hope is that 
the evaluation's results provide the state with a solid foundation for improving public policy. They 
clearly also offer guidance to other states and federal policymakers interested in reforming welfare. 

Since the late 1960s, people have sought to change welfare from a cash entitlement to a 
reciprocal obligation, in which welfare recipients would have to take steps toward work and the 
government would have to provide new opportunities and supports. GAIN is the nation's largest 
welfare-to-work program, and its passage in 1985 helped point to the pathbreaking federal legislation 
under which it operates, the Job Opportunities and Basic Skills Training (JOBS) Program, authorized 
by the Family Support Act of 1988. GAIN was ambitious in its goals: It sought to reduce dependence 
and increase self-sufficiency and, to accomplish that, provided comprehensive services emphasizing 
basic education as well as activities intended to get people quickly into jobs. 

There have been enduring questions about the feasibility of implementing a participation 
requirement and the ability of mandatory programs to change the message of welfare and make it more 
transitional and work-focused. More recently there have been new questions, growing out of the 
evidence from the 1980s on the success and limits of low-cost welfare-to-work programs that offered 
only job search: Would basic education and training increase program effectiveness? Could programs 
be successful with long-term recipients (including those in inner cities)? What were the trade-offs 
embodied in different approaches? 

This final report provides new information on the longer-term effects of GAIN and, for the first 
time, information on its cost and cost-effectiveness. The report shows that GAIN can benefit welfare 
recipients and taxpayers, and points to strategies for increasing program effectiveness. Key findings 
include the following: 

• GAIN can change the basic character of welfare to make it much more work- 
focuse,d, and in doing so get people jobs, reduce welfare costs, and save 
taxpayers money. 




• GAIN had some notable successes in all six study counties, but results varied 
considerably. While, overall, GAIN increased single parents' three-year 
earnings by 22 percent and cut welfare payments by 6 percent, impacts were 
particularly large in one county, where earnings went up 49 percent and welfare 
costs fell 15 percent. 

• This most successful county (Riverside) set a new standard of achievement, 
returning taxpayers $2.84 for each $1 invested. While many factors probably 
contributed to this success and to the county's relatively low average costs, key 
were a strong and pervasive employment-focused message (including the active 
use of job developers), a balanced use of basic education and job search, and 
adequate resources and commitment to extend a serious participation mandate to 
all GAIN-eligible people on welfare. 

• GAIN demonstrated the potential to succeed with a wide range of groups in the 
welfare population, including very long-term welfare recipients and people in a 
major inner city (Oakland). 

The evaluation showed that GAIN'S mixed service strategy - providing basic education and 
training in addition to job search - could yield better long-term results than had been found for 
programs that offered r lainly job search. However, the finding that services are a necessary but not 
sufficient condition for success poses a new ?nd critical challenge: to determine whether the techniques 
that worked so well in the more successful counties can be adapted and used to bring programs 
throughout the state and nation up to this high standard of performance. 

At a time of public cynicism about whether government can deliver, the results show that GAIN 
can work and be very cost-effective. In the context of the current debate about time-limiting welfare- 
without-work, gain's ability to increase the number of people getting unsubsidized jobs before a time 
limit would be reached is of great importance and provides a strong rationale for expanded funding 
for the very hard-pressed JOBS program. But the fact that, despite GAIN'S success, many people still 
remain on welfare and in poverty after several years also reminds us that reducing long-term welfare 
receipt remains a major challenge that will likely require a mix of strategies. 



Judith M. Gueron 
President 
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EXECUTIVE SUMMARY 



This report presents the latest findings on the effectiveness of California's Greater Avenues for 
Independence (GAIN) Program, a statewide initiative aimed at increasing the employment and self- 
sufficiency of recipients of Aid to Families with Dependent Children (AFDC), the nation's major cash 
welfare program. Based on three years or more of follow-up data for 33,000 people who entered 
GAIN betwee;n early 1988 and mid-1990, the study examines the program's effects in six counties on 
employment, earnings, welfare receipt, and other outcomes, as well as findings from a comprehensive 
benefit-cost analysis. The results are of broad relevance to welfare reform because California has the 
country's biggest AFDC caseload and GAIN is the largest and one of the most ambitious programs 
operating under the federal Job Opportunities and Basic Skills Training (JOBS) Program, created by 
the Family Support Act of 1988. Operating as California's JOBS program since July 1989, GAIN 
currently accounts for almost 13 percent of federal spending on JOBS. GAIN is overseen by 
California's Department of Social Services (CDSS) and administered by the 58 counties. This report 
i'o part of a multi-year evaluation conducted for CDSS by the Manpower Demonstration Research 
Corporation (MDRC). 

The Findings in Brief 

Each of the 33,000 sample members was assigned at random to either an experimental group 
(who were subject to GAIN'S participation requirements) or a control group (who were precluded from 
the program but could seek other services in the community on their own). The two groups were 
tracked over time, and the differences between them (e.g., in earnings and welfare receipt) constitute 
the effects or "impacts" of GAIN - the difference the program made. 

Single Parents (AFDC-FGs) 

Overall Over the entire three-year follow-up period, and across the six counties, GAIN 
produced increasing earnings impacts for single parents (AFDC-FGs), a group mostly with children 
age 6 or older when they enrolled in the study. In year 3, average earnings for the experimental group 
were $636 higher than the control group's average (a 25 percent gain); for the full three years, they 
were $1,414 higher (a 22 percent gain). (Earnings for each group were averaged over all members 
of each group, including those who did not work as well as those who did.) Moreover, some data 
point to sustained or still larger earnings impacts in the future. GAIN also continued to produce 
welfare savings in year 3 at the same level as in year 2. In year 3 and across the six counties, 
experirnentals received an average of $331 less in AFDC payments (an 8 percent reduction) compared 
to the control group average; the reduction was $961 (6 percent) for the entire three-year period. 
Longer-term trends suggest a gradual tapering off of these welfare effects in the future. 

GAIN also had an effect on the rate of AFDC case closures, biu it was not large. Across all 
six counties, over half of the experimental group was on AFDC in the last quaner of the three-year 
follow-up period (53 percent, or only 3 percentage points lower than the rate for controls). 

County-Specific. GAIN'S impacts on single parents varied across the six counties in the study. 
Riverside County, which had unusually large first- and second-year earnings gains and welfare savings. 
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again produced large effects in year 3. Over the three-year period. Riverside increased the 
experimental group's earnings by an average of $3,113, a 49 percent gain over the control group 
average. It reduced welfare payments by $1,983, a 15 percent reduction compared to the control 
group. These impacts were the biggest for any of the six counties, and are greater than those found 
in previous large-scale experimental studies of state welfare-to-work programs. Riverside also 
produced large earnings gains and welfare savings for a special sample — single parents with children 
under the age of 6. 

GAIN'S three-year impacts on earnings were moderate to large in three of the other five 
counties: $1,492 in Alameda (a 30 percent increase above the county's control group average), $1,474 
in Butte (a 21 percent increase), and $1,772 in San Diego (a 22 percent increase). Tulare produced 
a moderate impact ($518) in year 3, but its average effect for the full follow-up period was under 
$400, as was true in Los Angeles. Four of the remaining five counties (all but Tulare) achieved 
welfare savings for AFDC-FGs for the three-year period, ranging from an average of $782 per 
experimental in Alameda (a 4 percent reduction compared to the control group average) to $1,136 in 
San Diego (an 8 percent reduction). 

Benefits and Costs. GAIN was a relatively expensive program compared to the simpler and 
primarily job search welfare-to-work programs of the 1980s. For the single-parent sample in all six 
counties combined, over a five-year period, county welfare departments were estimated to have spent 
an average of $2,899 per experimental, about 60 percent of which was for case management functions. 
In addition, schools and other non-welfare agencies spent $1,515 per experimental to provide education 
and training instruction as part of the GAIN program, bringing the total cost of GAIN to $4,415 per 
experimental. Another important cost number is the net cost per experimental, which measures the 
government's net expenditures after adding the cost of education and training activities experimentals 
entered on their own after leaving GAIN, and then subtracting the cost of services that members of 
the control group received on their own. The net cost over five years was $3,422 per experimental 
for the six counties combined, but varied widely by county, from under $2,000 per experimental in 
Riverside and San Diego to over $5,500 in Alameda and Los Angeles. The higher costs in the latter 
two counties, which enrolled only long-term welfare recipients into their GAIN programs, reflect, to 
an important extent, a greater net increase in the use of education and training activities in Alameda 
and Los Angeles compared to the patterns in other counties. 

Net cost estimates are key because they are used in the benefit-cost study to determine whether 
the program costs or saves taxpayers money. That analysis also assesses whether people in the 
Qx\x 'Tiental group are made financially better off by the program. (The benefit-cost analysis does 
not take into account non-monetary gains or losses.) 

When measured earnings gains are compared to welfare reductions and other losses over five 
years, welfare recipients in five of the six counties (Alameda, Butte, Riverside, San Diego, and Tulare) 
were, on average, better off financially as a consequence of the GAIN program. Net benefits ranged 
from $948 per experimental in San Diego to $1,900 per experimental in Riverside, for an overall 
average of $923 per experimental. 

The GAIN program in two counties - Riverside and San Diego - resulted in government 
budgets coming out aliead. A third county - Butte - produced a "break-even" effect, while the 
results were negative in the remaining three counties. From the government budget perspective, a 
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positive result means that, on average, for every extra dollar the government invested per experimental 
(above and beyond the public cost of education and training controls received on their own initiative), 
it got more than a dollar back in the form of reduced costs for AFDC and other transfer programs and 
increased tax payments arising from experimentals* increased employment. This return was 
exceptionally large in Riverside - $2.84 per every net $1 invested. The return was $1.40 per $1 in 
San Diego, and $1.02 per $1 in Butte, but less than a dollar ($.76) per $1 for all six counties together. 
It is worth mentioning that return per net dollar invested is a standard of success by which few social 
programs are assessed. 

Heads of Two-Pa rent Famili es (AFDC-Us ) 

GAIN also produced earnings gains and welfare savings for the heads of two-parent families 
(AFDC-Us), who make up about 18 percent of all AFDC cases in California. Although the longer- 
term trends were not as impressive as they were for single parents, GAIN'S earnings effects over the 
full three-year follow-up period were moderate to large in three counties (Butte, Los Angeles, and 
Riverside, although they were declining over time in Riverside). They were especially large in Butte, 
reaching $3,295 per experimental. The same three counties also produced moderate to large welfare 
savings, as did San Diego. GAIN'S benefit-cost results for AFDC-Us show a large positive effect 
from the perspective of welfare recipients solely in Butte, and a modest positive return on the 
government's investment in Butte ($1.22 per net $1 invested) and Riverside ($1.61 per net $1 
invested). 

In sum, the results of this evaluation show that the GAIN program can work, especially for 
single parents on welfare, who account for about 82 percent of California's welfare caseload. For that 
group, both welfare recipients and the government budget came out ahead in two counties as a result 
of GAIN, with one county (Riverside) producing the most impressive results yet observed for a large- 
scale welfare-to-work program. Of the remaining four counties, three made welfare recipients better 
off, but without producing net budgetary savings (although the government essentially "broke even" 
in one). An important open question is whether some of the implementation approaches of the better- 
performing counties, especially those of Riverside, can be adapted by other localities and produce 
similarly impressive results. 



The GAIN Program Model 

A key feature of GAIN, which distinguishes it from most other welfare-to-work and JOBS 
programs, is the way it uses educational and basic skills levels to sort registrants into one of two 
service streams. Those who do not have a high school diploma (or a General Educational 
Development certificate — a GED) or fail to achieve predetermined scores on both parts of a math and 
reading test or are not proficient in English are deemed by GAIN to be "in need of basic education." 
These individuals can choose to attend a basic education class - Adult Basic Education (ABE), GED 
preparation, or English as a Second Language (ESL) instruction - or a job search activity first, but 
if they choose job search and fail to obtain employment, they must then enter basic education. 
Registrants judged "not in need of basic education" - those who pass both parts of the math and 
reading test and possess a high school diploma (or a GED) — usually must participate in job search 
first. Registrants already enrolled in education and training programs when they enter GAIN may 
continue in those activities if the activities meet certain criteria (e.g., they must prepare registrants for 
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occupations in need of workers in the. local labor market, and registrants must be able to complete the 
training within two years after enrolling in GAIN). Participants in any of these three sequences who 
do not find employment after completing their initial activities undergo an employability assessment 
designed to help them choose their next activity, e.g., skills training, vocationally oriented post- 
secondary education, on-the-job training, or unpaid work experience. Any GAIN registrant, who, 
without "good cause," fails to participate in GAIN's orientation and services may incur a "sanction," 
i.e., a reduction of the welfare grant. (The grant level in California is one of the nation's highest.) 



The GAIN Evaluation 

The six counties selected to participate in the study of GAIN'S impacts capture a wide variet)' 
of local conditions and population characteristics account for more than one-third of the state's GAIN 
caseload and more than one-half of its AFDC caseload. Three counties are in southern California: 
Los Angeles, with about one-third of the state's caseload and a welfare population larger than all but 
a few states'; San Diego with the state's second-largest caseload; and Riverside, a county 
encompassing both urban and rural areas. Two counties are in northern California: Alameda, an urban 
county that includes the City of Oakland, and, further north, the county of Butte, which had the 
smallest population of the six counties. Tulare is located in the largely agricultural, rural Central 
Valley. (Table 11, at the end of this summary, presents a brief profile of each county.) 

It is important to stress that this report's descriptions of the counties' strategies for implementing 
GAIN are based on information collected no later than mid-1991, and prior to that in most cases. This 
is the relevant information for describing the research sample's actual experiences in GAIN. However, 
some of the information does not portray the counties current modes of operating GAIN. All of the 
counties have continued to revise their implementation strategies as they have acquired more 
experience in operating this very complex welfare-to-work initiative, and in response to changes in 
funding and other circumstances. 

The findings on GAIN'S implementation, effectiveness, and benefits and costs come from a 
study of 33,000 applicants for and recipients of AFDC whose participation in GAIN was mandatory, 
i.e., a condition for receiving their full welfare grant. This group included single heads of families 
(AFDC-FGs, who are usually mothers) mostly with children age 6 or older, and all heads of two- 
parent families (AFDC-Us, typically fathers). (It is important to note that almost one-third of 
Alameda's sample consisted of single parents with children younger than age 6.) 

During the period in which members of the research sample enrolled in GAIN and thus became 
part of the study (March 1988 to June 1990), four of the six counties had sufficient resources to enroll 
all registrants in their caseloads who were mandatory for GAIN under the pre-JOBS rules. The other 
counties - Alameda and Lx)s Angeles - focused exclusively on long-term recipients, in conformity 
with GAIN'S rules in cases where resources did not permit serving all those required to participate. 

To determine the effects of GAIN, mandatory registrants who attended an orientation to the 
program were randomly assigned to either an experimental group (who were subject to GAIN'S 
participation mandate) or a control group (who were precluded from GAIN but could seek other 
services in the community). Random assignment assured that th ^ two groups did not differ 
systematically on measured and unmeasured background characteristics when they entered the study. 
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and that any differences in their subsequent labor market and welfare experiences could be attributed 
with confidence to the GAIN program. The two groups' employment rates, average earnings, average 
AFDC payments, and other outcomes were compared over the course of the follow-up period, and the 
differences between them are referred to as the estimated "impacts" of GAIN. The data used in this 
study came from a variety of sources, including automated employment, earnings, and welfare records 
for the full 33,000-person sample, a registrant survey administered two to three years after orientation 
to a subsample of experimentals and controls in five counties (excluding Butte because of the 
evaluation's limited survey budget), and program participation and fiscal information obtained from 
the counties and various state agencies. 



Findings on Program Implementation 

• The six comities made different decisions about how much to emphasize 
quick entry into the labor market versus the longer and more expensive 
process of building registrants' human capital through education and 
training* 

Not surprisingly, given California's state-supervised but county-operated welfare system, and 
the absence of evidence when GAIN started as to what strategies would work best, the six counties 
varied in how they sought to prepare registrants for employment. Viewing almost any job as a positive 
first step, with advancement to come by acquiring a work history and learning skills on tihe job, 
Riverside's staff placed much more emphasis on moving registrants into the labor market quickly than 
did the staff in any other countj'. Most distinctive '^was Riverside's attempt to communicate a strong 
"message" to all registrants (even those in education and training activities), at all stages of the 
program, that employment was central, that it should be sought expeditiously, and that opportunities 
to obtain low-paying jobs should not be turned down. The county's management underscored this 
message by establishing job placement standards as one of several criteria for assessing staff 
performance, while at the same time attempting to secure the participation of all mandatory registrants. 
In addition, the county instituted a strong job development component to assist recipients in gaining 
access to job opportunities. 

Alameda illustrates a very different approach. Its GAIN managers and staff believed strongly 
in "human capital" development - the use of education and training as a path to getting jobs that offer 
a better chance to get off or stay off welfare. Within the overall constraints imposed by the GAIN 
model's service sequences, Alameda's staff encouraged registrants to be selective about the jobs they 
accepted and to take advantage of GAIN'S education and training to prepare for higher-paying jobs. 
Butte, Los Angeles, San Diego, and Tulare took approaches falling between those of Riverside and 
Alameda, but closer to Alameda's than to Riverside's. 

• All six counties successfully communicated to registrants that the 
participation requirement was real and would be enforced, although the 
counties varied in the extent to which they relied on GAIN'S formal penalty 
process* 

Over 90 percent of experimentals said on the registrant survey that they believed it was "likely" 
or "very likely" that their AFDC grants would be reduced if they were assigned to a GAIN activity 
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but did not go. Casefile records showed that up to about 6 percent of experimentals (in Los Angeles 
and Riverside) were sanctioned within the first 11 months after GAIN orientation, although self- 
reported information from the survey and interviews with GAIN staff suggest that the rates rose over 
time in all the counties. Evidence also suggests that case managers in Los Angeles and Riverside were 
quickest to invoke the "threat" of sanctioning in response to noncompliance. About half to three- 
quarters of survey respondents believed the participation mandate to be "fair" and "a good idea," and 
only about one-quarter of respondents in both the experimental and control groups agreed with the 
statement, "Making welfare mothers work if they don't want to is bad for their children." 



Impacts on Participation in Employment-Related Activities for AFDC-FGs 

An important measure of the GAIN intervention, a major determinant of its net costs, and a 
potentially key influence on its impacts is the extent to which experimentals had different participation 
patterns than controls. 

To determine GAIN'S effect on experimentals' use of employment-related activities, the 
evaluation compared experimentals' rates and duration of participation in all such activities (including 
GAIN and post-GAIN participation) with the amount of participation in non-GAIN activities by the 
control group. The difference in the amount of participation represents the "impact" of GAIN, which 
tells how much experimental' participation changed compared to what it would have been in the 
absence of GAIN. 

• A sizable number of controls used non-GAE>I employment-related activities, 
usually vocational training and post-secondary education. 

Few controls (4 percent) participated in job search activities, which, in comparison to 
opportunities for education and training, are not widely available in the community. Moreover, few 
(8 percent) participated in basic education classes (for ABE, G£D, and ESL instruction). Although 
more widely available, basic education may have been of less interest to controls than occupational 
skills training (nor was it generally needed by those who already had a high school diploma or GED). 
Only a handful of controls took part in unpaid work experience and on-the-job training (OJT) 
assignments. In contrast, a full 23 percent participated in vocational training or post-secondary 
education. 

• The GAJN program substantially increased experimentals' participation in 
job search and basic education. 

Given that the GAIN model requires most participants to enter upfront job search or basic 
education as their initial GAIN activity, it is not surprising that GAIN'S largest impacts were on the 
use of tliese two activities. Across all six counties, 29 percent of experimentals participated in job 
search compared to only 4 percent of controls, for a difference of 25 percentage points. Similarly, 
GAIN increased experimentals' participation in ABE, GED, and ESL activities (taken together) by 28 
percentage points. The program had little overall impact (3.3 percentage points) on the percentage 
who participated in vocational training or post-secondary education, although, as discussed later in this 
summary, it did in some counties (especially Alameda) for registrants determined not to need basic 
education. Few experimentals took part in unpaid work experience (PREP) or OJT. (More recently, 
the use of PREP has increased in several counties.) 
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Im pacts on Employment. Earmngs, and Welfar<^ Outcomes for AFDC-FGs 
Impacts on Earnings and Welfare Payments 

• GAIN increased the ayerage earnings of experimentals by 25 percent in the 
third year after orientation, continuing its trend of progressiyely stronger 
earnings effects oyer time. It reduced experimentals' ayerage AFDC 
payments by 8 percent, a result that reflected a leyeling off of GAIN'S 
impacts on this measure. 

The average earnings for all experimentals and all controls were calculated for the full sample, 
including people who did not work (and whose earnings were counted as zero). Averaged across the 
six counties, with each county given equal weight, earnings for AFDC-FGs in the third year (as shown 
in official automated earnings records) were $3,159 per experimental group member and $2,523 per 
control group member. This yields an earnings gain, or impact, of $636 per experimental (or 25 
percent of the average control group member's earnings), as shown in the "all counties" section of 
Table 1 . (This, again, is an average that includes sample members who did not work at all; those who 
worked benefited more than this $636 suggests.) Welfare savings were $331 per experimental in year 
3 (i.e., AFDC payments were 8 percent lower than the average payments of $4,163 for controls). As 
indicated by the asterisks for the "all counties" rows in Table 1, these results were statistically 
significant, meaning that one can have greater confidence that they were due to the progiim rather 
than to statistical chance,^ The earnings impacts compare favorably with the three-year results for 
simpler (mostly job search) programs studied previously, and the AFDC impacts compare very 
favorably. 

Over the entire three-year follow-up period, GAIN'S earnings impacts grew progressively larger. 
Averaged across the six counties, with each county given equal weight, the program's impact on 
earnings nearly doubled between the first and second years of follow-up and rose by another 24 
percent between the second and third follow-up years, reaching $1,414 per experimental for the entire 
period. (See Table 1 and Figure lAO An analysis of GAIN'S effects for an early cohort of sample 
members (i.e., those who entered the study early on and for whom more quarters of foUow-up are 
available) points toward sustained or still larger earning impacts after the third year. 

GAIN'S effects on AFDC payments leveled off in year 3, but totaled $961 for the full three-year 
period. (See Table 1 and Figure IB.) After having grown by about 23 percent between years 1 and 
2, they were about the same in year 3 as in year 2. Longer-term trends for the early cohort suggest 
a gradual tapering off of these welfare effects in the future. 

• GAIN'S impacts varied by county* One county (Riverside) had large 
earnings gains and welfare savings in all three follow-up years. Three 
counties (Alameda, Butte, and San Diego) had more moderate earnings gains 
and welfare savings* Of the two remaining counties, one (Los Angeles) 
achieved welfare savings but with little effect on earnings gains, while the 
other (Tulare) produced earnings gains but with little effect on welfare 
payments* 



'Some of the year 1 and year 2 numbers in this and other tables differ slightly from those reported earlier 
because they were recalculated using updated earnings and AFDC data. 
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FIGURE 1 



GAIN'S THREE-YEAR IMPACTS ON EARNINGS AND AFDC PAYMENTS 
FOR AFDC-FG REGISTRANTS 



A. Impacts on Earnings 
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Riverside, which had unusually large first- and second-year earnings gains and welfare savings, 
also produced large third-year effects on AFDC-FGs. (See Table 1 and Figure 1.) Over the entire 
three-year period, the experimental group's earnings in Riverside were $3, 1 13 higher, on average, than 
the control group's earnings, an increase of 49 percent. Their welfare payments were $1,983 lower, 
a 15 percent reduction compared to the control group. These impacts were the largest in any of the 
six counties, and are larger than those found in previous large-scale experimental studies of state 
welfare-to-work programs. They are notable as much for their consistency as for their magnitude: 
Riverside had statistically significant earnings gains for many key subgroups of the single-parent 
research sample, and these gains were almost always accompanied by welfare savings. Such a 
consistent pattern was not found in any other county. 

Among the other five counties, three (Alameda, Butte, and San Diego) had middle-level three- 
year earnings impacts ($1,474 to $1,772 per experimental, or 21 to 30 percent above the control group 
average). Also of note was the $518 earnings impact in year 3 for Tulare, where positive and statis- 
tically significant effects were observed for the first time. Four of these five counties (Tulare was the 
exception) achieved moderate welfare savings (ranging from $782 per experimental over the three 
years to $1, 136, or a 4 to 8 percent reduction). (The three-year earnings and welfare impacts in Butte 
were not statistically significant, possibly owing to the small control group sample size there.) 

In Los Angeles, the finding that GAIN produced welfare savings but had little effect on earnings 
($260, and not statistically significant) may have resulted from GAIN'S producing an increase in the 
rate of employment, but in jobs that were low-paying, of short duration, or both. The welfare savings 
may also partly reflect the influence of financial sanctions (grant reductions) for noncompliance with 
GAIN'S participation mandate and any effect the mandate may have had in increasing or hastening case 
closures among experimentals who were working "off the books. " It is also worth noting that although 
the earnings impact in Los Angeles was small overall, this was not true in all five of the county's 
GAIN offices. The two offices located outside of central-city areas produced three-year earnings 
impacts exceeding $2,100 per experimental (an effect that was statistically significant in one office). 
None of the other offices, all of which were in central-city locations, produced an earnings gain. 

In Riverside, each of the four local offices operating GAIN in the four economically diverse 
regions of that county produced large and statistically significant earnings gains and welfare savings. 
San Diego also had consistently positive results (though not always statistically significant) across most 
of its local offices, but Tulare did not. (Alameda and Butte each had only one GAIN office.) 

Ali in all, the evidence of impacts across the six counties shows that GAIN can produce 
earnings gains, welfare savings, or both within a three-year period, even when it is operated in very 
different ways and under different circumstances. This is an encouraging finding because local 
conditions will always vary across counties and because some variation in key implementation practices 
is inevitable. 

Impacts on Employment Rates. Earnings Levels, and Job Quality 

• GAE^ increased the proportion of experimentals who were ever employed 
in year 3 by 6 percentage points above the control group rate. At the same 
time, a majority of experimentals as well as controls did not work at all 
during that year. 
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For the six counties combined, automated official records show that 40 percent of experimentals 
had worked at some time during year 3 compared to 34 percent of controls, resulting in a statistically 
significant difference of 6 percentage points (see Table 2). A similar impact is found when the 
proportions of experimentals and controls ever employed over the entire three-year period are 
compared (57 percent versus 51 percent, respectively). GAIN'S impact on the rate of employment was 
largest in Riverside, where it exceeded 9 percentage points in year 3 and almost 14 percentage points 
over the full follow-up period. Despite this accomplishment, the data in Table 2 imply that, across the 
six counties, about two-thirds of experimentals and controls did not work during year 3, and almost 
half never worked during the entire three-year period. In response to a question on the registrant 
survey in four counties (Alameda, Riverside, San Diego, and Tulare), about 60 percent of 
experimentals who were not working at the time of the interview said that they were not looking for 
work. Of that group, 28 percent cited their own ill health or disability as the most important reason, 
4 percent cited the ill health or disability of their children, and 22 percent said that they were in a 
school or training program. Only 4 percent said that the main reason they were not looking fo** work 
was that they could not afford or arrange for child care (perhaps in part because the study sample was 
composed largely of women with no preschool-age children), although 10 percent said that their major 
reason was that they wanted to stay home with their children. 

Of those who had never worked during the survey follow-up period, only 34 percent said that 
they had heard of the Earned Income Tax Credit (EITC), a federal tax credit for low-income workers 
intended to enhance the financial payoff from working. Of those who had worked, 54 percent said that 
they had heard of it. 

• Riverside and San Diego produced earnings gains mostly by increasing the 
rate and duration of employment, while Alameda and Butte produced about 
half their earnings gains by increasing the amount of money earned per 
quarter of employment. 

In Riverside and, to a lesser extent in San Diego, GAIN appears to have produced earnings 
impacts because experimentals had higher employment rates and more quarters of employment, but 
the jobs they held paid about as much, on averrge, as the jobs held by controls. In Alameda and 
Butte, in contrast, approximately half the earnings gains were associated with increased earnings per 
quarter of employment for experimentals, implying that, on average, experimentals who worked held 
better jobs than controls who worked. 

These differences across the counties are also reflected in the characteristics of the most recent 
jobs reported on the registrant survey by experimentals and controls who had worked at some time 
during the two- to three-year follow-up period. In Riverside, similar proportions of employed 
experimentals and employed controls (64 percent) had worked full-time (i.e. , 30 hours a week or more) 
in their most recent job, and average weekly wages were somewhat lower for all workers in the 
experimental group ($191 per week) than for all workers in the control group ($206). In contrast, 
employed experimentals in Alameda got jobs providing more hours of work per week than the jobs 
obtained by employed controls (e.g., 59 percent versus 55 percent, respectively, were full-time), and 
higher weekly wages for those working ($209 versus $167). 

It is also of interest that approximately 28 percent of employed experimentals in the four 
counties had jobs providing health care coverage. Among controls, the rate was 25 percent. 
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TABLE 2 



GAIN'S THREE-YEAR IMPACTS ON RATES OF EMPLOYMENT AND WELFARE CASE CLOSURES 

FOR AFDC-FGs (SINGLE PARENTS) 



County 
and Year 



Alameda 

' Year 1 
Year 2 
Years 
Total 



Ever Employed in the Specified Year 



Experimental (%) Controls (%) 



Difference 



On AFDC in the Last Quarter of the Specified Year 
Experimentals (%) Controls (%) Difference 



30.1 
32.8 
33.9 
48.8 



27.3 
26.3 
26.7 
40.8 



2.8 

6.5 *** 
•J 2 *** 

8.0 *** 



86.0 
76.6 
67.5 
n/a 



89.2 
77.1 
70.6 
n/a 



-3.2 
-0.5 
-3.1 
n/a 



Butte 
Year 1 
Year 2 
Year 3 
Total 



42.3 
46.3 
46.7 
63.4 



45.6 
42.2 
42.5 
63.7 



-3.3 
4.0 
4.3 

-0.2 



65.0 
49.4 
39.7 
n/a 



68.4 
47.7 
41.0 
n/a 



-3.4 
1.7 

-1.3 
n/a 



Los Angeles 
Yearl 
Year 2 
Year 3 
Total 

Riverside 
Yearl 
Year 2 
Year 3 
Total 



27.0 
26.9 
26.0 
39.4 



52.1 
49.4 
44.5 
67.1 



24.9 
22.9 
22.4 
34.9 



34.0 
35.4 
35.2 
53.4 



2.1 

4.0 *** 
3.6 *** 
4.5 *** 



18.0 *** 
14.0 *** 
9.3 *** 
13.6 *** 



84.8 
74.0 
63.8 
n/a 



58.7 
46.6 
40.6 
n/a 



87.9 
76.3 
67.5 

n/a 



65.9 
52.0 
45.8 
n/a 



-3.1 *** 
-2.3 
-3.7 ** 
n/a 



"7 2 *** 
-5.4 *** 
-5.2 *** 
n/a 



S an Piego 
Yearl 
Year 2 
Year 3 
Total 



46.0 
45.8 
42.5 
62.2 



40.0 
40.8 
37.3 
56.5 



6.0 *** 

5.1 *** 

5.2 *** 
5.7 *** 



69.1 
56.0 
49.0 
n/a 



72.1 
61.1 
51.9 
n/a 



-3.1 
-5.1 
-3.0 
n/a 



Tulare 

Yearl 
Year 2 
Year 3 
Total 

All counties (a) 
Yearl 
Year 2 
Year 3 
Total 



39.9 
41 .8 
43.9 
59.5 



39.6 
40.5 
39.6 
56.7 



40.9 
42.3 
38.0 
55.3 



35.5 
35.0 
33.7 
50.8 



-1.0 

-0.5 
5.8 *** 
4.2 ** 



4.1 *** 
5.5 *** 
5.9 *** 
6.0 *** 



76.7 
05. 4 
54.5 
n/a 



73.4 
61.3 
52.5 
n/a 



75.0 
62.2 
56.2 
n/a 



76.4 
62.7 
55.5 
n/a 



1.7 
3.1 
-1.7 
n/a 



-3.1 *** 
-1.4 
-3.0 *** 
n/a 



NOTES: The totals indicate the proportion of sample memlDers who were ever employed at any time during the three years 
of follow-up. Totals are not applicable (n/a) in the AFDC panel of the table. 

Statistical significance levels are indicated as *** = 1 percent (the highest level); ** = 5 percent; * = 10 percent. 

(a) In the all-county averages, the results for each county are weighted equally. 
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* GAIN increased the proportion of experimental who had more substantial 
earnings* 

Table 3 shows that, for all six counties combined, about 20 percent of experimentals earned at 
least $5,000 in year 3 compared to 16 percent of controls, for an impact of almost 4 percentage points; 
12 percent of experimentals, compared to 9 percent of controls, earned at least $10,000 - an amount 
of money that exceeds the poverty line for a single parent with one child. 

Another way to view earnings levels is to consider what proportion of workers, rather than all 
experimentals or all controls, earned above certain thresholds. Although experimental-control 
differences on such a measure are not true estimates of GAIN'S impacts (since the background 
characteristics of those who found jobs in each group may not have been equivalent), they illustrate 
that many of those who did find work had more substantial earnings. For example, for all six counties 
combined, about 31 percent of all employed experimentals earned above $10,000 in year 3. Among 
employed controls, the rate was 27 percent. 

* GAIN produced a small increase in the proportion of experimentals whose 
combined income from earnings, AFDC, and Food Stamps exceeded the 
poverty line in year 3. 

To approximate GAIN'S effects on poverty, the analysis compared sample members' total year 
3 earnings, AFDC payments, and Food Stamps with the official poverty line, taking into account the 
size of each sample member's family at the time of GAIN orientation. (In 1992, the poverty line for 
a single parent with one child was $9,190.) The income measure used here is different from the 
Census Bureau's official poverty measure in that Food Stamps are not counted in the official measure, 
while other family income not measured in the GAIN evaluation is counted. The analysis suggests that 
GAIN helped move some families out of poverty: 20 percent of the experimentals across the six 
counties, compared to 17 percent of the controls, had a combined income above the poverty line. In 
other words, experimentals' poverty rate was reduced by 3 percentage points. This impact reached 
almost 5 percentage points in Butte and Tulare. 

Im pacts on Case Closures 

* GAIN reduced by a small amount (3 percentage points) the proportion of 
experimentals who were on AFDC during the last quarter of year 3* About 
half of all experimentals and controls received some AFDC payments during 
that period* Only about one-fifth were both off AFDC and working* 

Table 2 shows the proportion of sample members who had received any AFDC payments in the 
last quarter of each follow-up year. The proportion of experimentals on AFDC had dropped to 53 
percent (for all six counties combined) by tfie end of the three-year period. However, only a portion 
of this change can be attributed to GAIN, since the control group experienced a similar decline. 
Nonetheless, the counties collectively produced a reduction of 3 percentage points in the proportion 
of experimentals receiving welfare by the end of year 3, ranging from under 2 percentage points in 
Butte and Tulare to over 5 percentage points in Riverside. 

Table 3 (bottom panel) shows the proportion of people who had both worked and received no 
AFDC payments during the last quarter of the follow-up period. This combined status comes closer 
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TABLE 3 



GAIN'S IMPACTS ON YEAR 3 EARNINGS LEVELS AND THE PERCENTAGE OF AFDC-FGs (SINGLE PARENTS) 

BOTH EMPLOYED AND OFF AFDC AT THE END OF YEAR 3 

OLrtcome Measure 

and County Experimentais (%) Controls (%) Difference 

Earned $5,000 or 
more in year 3 

Alameda 16.4 12.7 3.7* 

Butte 21.9 18.8 3.1 

Los Angeles 12.6 12.0 0.6 

Riverside 23.7 17.1 6.6 

San Diego 23.3 19.7 3.6 

Tulare 20.6 17.6 3.0 

All counties (a) 197 16,3 3^ 

Earned $10,000 or 
more in year 3 

Alameda 10.6 8.4 2.2 

Butte 14.6 10.2 4.3 

Los Angeles 7.7 6.7 1.0 

Riverside 13.7 9.5 4.2 

San Diego 15.0 12.0 3.1 

Tulare 11.2 8.2 3.0 

All counties (a) ^2^ 9,2 3,0 



*** 
*** 



*** 
*** 
** 
*** 



Employed and received no 
AFDC in the last quarter of year 3 

Alameda 14.2 10.0 4.2 

Butte 22.8 22.0 0.8 

Los Angeles 11.2 9.1 2.1 

Riverside 23.0 18.4 4.6 

San Diego 21.4 18.8 2.6 

Tulare 19.9 17.6 2.3 

All counties (a) 18,8 16,0 2,8 

NOTES: Statistical significance levels are indicated as *** = 1 percent (the highest level); ** = 5 percent; * = 10 percent, 
(a) In the all -county averages, the results for each county are weighted equally. 



*** 
** 
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than any other measure in this study to representing the achievement of "self-sufficiency through 
employment." By this criterion, about 19 percent of experimentals (for all six counties combined) 
achieved self-sufficiency by working compared to 16 percent of controls, for a small (statistically 
significant) impact of almost 3 percentage points. The impact on this measure was highest in Riverside 
and Alameda, where it exceeded 4 percentage points. (During this same quarter, another 10 percent 
of experimentals both worked and received welfare.) 

• Several count!ies increased the proportion of registrants who made a 
permanent exit from AFDC during the available follow-up period, although 
this effect was not large. 

Welfare recipients who leave AFDC often return to the rolls. Across the six study counties, 
27 percent of experimentals who left AFDC for at least one full quarter during the first half of the 
follow-up period (i.e., from quarters 2 through 7) returned to AFDC before the three years were out. 
(This rate ranged from 22 percent in Los Angeles to 30 percent in Tulare.) Nonetheless, three counties 
increased the likelihood that experimentals would get off welfare and remain off the rolls. For 
example, 39 percent of all experimentals in Riverside, compared to 35 percent of all controls, had left 
AFDC during the first half of the three-year follow-up period and did not return during the rest of that 
period. This 4 percentage point difference was statistically significant and accounts for more than half 
of Riverside's impact of nearly 8 percentage points on the total percentage of experimentals who left 
AFDC within the first half of the follow-up period. Los Angeles and San Diego each had an impact 
of 3 percentage points (statistically significant) on the likelihood of exiting AFDC and remaining off 
welfare through the end of the follow-up period, but little effect was detected in the other three 
counties (Alameda, Butte, and Tulare). 



Impact Frndmes for Selected AFDC-FG Subgroups 

• For the two basic education subgroups, GAIN produced earnings gains and 
welfare savings, but not always for both groups in each coimty. 

A central question for GAIN is whether particular subgroups of welfare recipients are or are 
not affected by the services the program offers and by its participation mandate. All GAIN registrants 
were classified into two groups for whom the GAIN program model established different service 
sequences: those determined "not in need of basic education" and those deemed "in need of basic 
education." Overall, GAIN produced earnings gains and welfare savings for both of these subgroups 
among AFDC-FGs. 

Three counties (Alameda, Riverside, and San Diego) produced large earnings gains — ranging 
from about $3,CX)0 to $4,000 — for registrants determined not to need basic education, as shown in 
the top panel of Table 4. Two of these counties (Riverside and San Diego) also produced large 
welfare savings, while the third (Alameda) did not. (The pattern in Alameda could have occurred if 
its earnings impact was concentrated among individuals who, during the follow-up period, would have 
left welfare and worked even in the absence of GAIN, but in lower-paying jobs.) In contrast, Los 
Angeles achieved large welfare savings for this subgroup, but more modest (and not statistically 
significant) earnings gains. 
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Alameda's success (noted above) in raising the quality of jobs suggests that the use of job search 
to explore career options, combined with subsequent participation in vocational training and post- 
secondary education, may have played a role in producing Alameda's earnings unpact. As the top 
panel of Table 5 shows, Alameda raised experimentals' participation in training and post-secondary 
education 16 percentage points, on average, above the control group rate - a participation impact that 
was higher than in the other counties; it also had the largest impact on the duration of participation in 
these activities. Moreover, Alameda increased the proportion of experimentals in the not-in-need-of- 
basic-education subgroup who received a trade certificate by almost 6 percentage points (not 
statistically significant) and receipt of a Bachelor's degree by 3 percentage points. In contrast. 
Riverside did not increase participation in training and post-secondary education, nor did it increase 
the receipt of education credentials, implying that its earnings impacts for this subgroup came about 
from other sources — possibly through a combination of factors, including the large impact on 
participation in job search activities (48 percentage points, as shown in the top panel of Table 5) and 
other program features that made Riverside distinctive. (See the section above on implementation 
findings.) San Diego's experience appears to have been closer to Riverside's in that it did not have a 
large impact on the use of vocational education and training. 

For registrants who were determined to need basic education, increasing experimentals' use of 
ABE, GED, and ESL classes (relative to the use of those classes by controls) may have contributed 
to positive earnings impacts, for Butte, Riverside, and Tulare all had a positive impact on the rate of 
participation in those activities (see the bottom panel of Table 5 for the Riverside and Tulare impacts). 
All three counties (Tulare to a lesser extent) also produced statistically significant earnings increases, 
as shown in the middle panel of Table 4. In addition, two of them (Butte and Riverside) produced 
welfare savings. At the same time, the experience of the other three counties indicates that even a 
large impact on the use of basic education may not result in earnings gains. For example, Alameda 
had a 56 percentage point impact on the in-need-of-basic-education subgroup's rate of participation in 
basic education, yet its three-year impact on this group's earnings was relatively small. 

If an impact on the use of basic education contributes to an impact on earnings, the mechanism 
by which this occurs may sometimes involve factors other than simply an increase in basic skills or 
credentials. For example, it is noteworthy that Riverside achieved its earnings gain for this subgroup 
without having had an impact on the proportion of experimentals who obtained a GED and without 
having an impact on literacy skills.^ Furthermore, impacts on GED attainment were found in 
Alameda (an 8 percentage point impact), while impacts on the literacy test were concentrated in San 
Diego - two counties that did not produce a statistically significant increase in earnings for this 
subgroup. 

It is possible that in Riverside (and perhaps elsewhere) basic education may have increased skills 
not measured by the literacy test used in this evaluation, or increased participants' interest in - or self- 
confidence about - working. Perhaps these kinds of influences, when combined with other aspects 
of Riverside's implementation of GAIN (including its strong employment message and its substantial 
impact 9f 31 percentage points on the rate of participation in job search for the in-need-of-basic- 
education subgroup, as shown in the bottom panel of Table 5), help to explain why Riverside achieved 
an impressive earnings impact for this subgroup without improving measured educational gains. 



^See Karin Martinson and Daniel Friedlander, GAIN: Basic Education in a Welfare-to-Work Program 
(New York: MDRC, 1994). 
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TABLE 5 



GAIN'S IMPACTS ON THE RATE OF PARTICIPATION IN KEY ACTIVITIES 
WITHIN TWO TO THREE YEARS AFTER ORIENTATION FOR AFDC-FGs (SINGLE PARENTS) 



A. Registrants Uetermmed Not to Need Basic Education 

Ever Participated in Ever Participated in Vocational Training 
Job Search Activities or Post- Secondary Education 

County Experimentals (%) Controls (%) Difference Experimental (%) Controls (%) Difference 



Alameda 
Los Angeles 
Riverside 
San Diego 
Tulare 

All counties (a) 



55.9 


3.6 


52,3 


48.3 


31.9 


16.4 


25.8 


2.9 


22,9 


27,6 


23.0 


4.6 


50.1 


2.3 


47,8 


40,9 


43.3 


-2.4 


41.9 


7.9 


34,0 


48.3 


43.5 


4.8 


46.4 


3.0 


43,4 


48.8 


36.7 


12.1 


44.0 


3.9 


40,1 


42.8 


35.7 


7.1 



B. Registrants Determined to Need Basic Education 

Ever Participated in 
Job Search Activities 



Ever Participated in Basic Education 
(ABE. GED. or ESL) 



County 



Experimentals (%) Controls (%) Difference Experimentals (%) Controls (%) Difference 



Alameda 19.6 3.8 

Los Angeles 11.2 3.8 

Riverside 32.0 0.7 

San Diego 27.4 7.5 

Tulare 12.4 0.9 

All counties (a) 20.5 3.3 



15.8 65.1 9.2 55.9 
7.4 49.2 10.8 38.4 

31.3 40.6 14.5 26.1 

19.9 42.1 11.8 30.3 
11.5 65.6 13.3 52.3 
17.2 52.5 11.9 40.6 



NOTES: Estimates of participation rates for the two- to three-year follow-up period, which rely partly on data from 
the registrant survey, are not available for Butte. 

Tests of statistical significance were not performed. 

(a) In the all -county averages, the results for each county are weighted equally. 
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• GAE^I produced earnings and welfare savings for a variety of other 
subgroups, including (in some counties) registrants who had received AFDC 
for more than two years prior to entering the program, showing GAIN'S 
potential to reach a difficult-to-serve population. 

Among long-tenn recipients, the total three-year earnings impact was moderate to large (and 
statistically significant) in three counties (Alameda, Butte, and Riverside), ranging from $1,492 to 
$3,538, as shown in the bottom panel of Table 4, Three-year welfare savings of $782 to $2, 184 v/ere 
found across five counties (and were statistically significant in four of them). It is noteworthy that 
Riverside produced the largest earnings gains and the largest welfare savings for long-term AFDC-FG 
recipients. It also produced statistically significant impacts on these outcomes when "long-term" is 
defined more strictly to mean recipients who received AFDC continuously for at least the six years 
prior to orientation. 

The evaluation examined GAIN'S impacts on a variety of other subgroups and found evidence 
of earnings gains and welfare savings, although not consistently in all counties. Across racial and 
ethnic groups, the largest impacts were found among whites and blacks. For blacks in Alameda (who 
constituted almost 70 percent of that county's sample), there was a relatively large year 3 earnings 
impact of $1,020. These results in Alameda are especially interesting because that county's sample 
was drawn entirely from relatively long-term recipients and an inner-city area (Oakland). For 
Hispanics in the three counties that had large samples of Hispanics (Los Angeles, Riverside, and San 
Diego), only Riverside produced a statistically significant earnings impact in year 3 ($920), but none 
of the three produced statistically significant welfare savings for this group. 

In some counties, GAIN also achieved impacts for individuals facing conditions commonly 
thought to reflect important barriers to employment. As previously discussed, the program produced 
earnings gains and welfare savings for subgroups with long welfare histories (as it did for those who 
were welfare applicants or shorter-teim recipients when registering for GAIN). It also achieved 
impacts for those with little employment experience prior to entering GAIN and for those with two or 
more children. At the same time, however, it had weak earnings effects for a "most- disadvantaged" 
subgroup, defined as sample members with multiple barriers: more than two years' previous receipt 
of AFDC and no employment in the year preceding GAIN orientation and no high school diploma. 
Larger earnings impacts for this group may be particularly difficult to achieve because of those 
multiple barriers, although Riverside's success in doing so shows GAIN'S potential to reach even them. 



Impact Findings for Single Parents with Children Younger than Age 6 in Three Counties 

• gain's impacts on single parents with children under the age of 6 largely 
paralleled its impacts on single parents whose children were age 6 or older 
in three counties. 

Under the JOBS legislation, starting in July 1989, GAIN'S participation mandate was extended 
to single parents with children 3 to 5 years old at the time of orientation. Although this group was 
not part of the main research sample for the evaluation (except in Alameda), employment, earnings, 
and welfare data were collected for a supplementary sample of such individuals in Riverside and 
Tulare. This sample was somewhat younger, on average, than the main sample, but fewer than a 
quarter of them were under age 25, 
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Over the entire three-year follow-up period, Riverside produced large average increases in 
earnings ($3,511) and reductions in AFDC payments ($2,558) for this group, just as it had for its main 
sample. Similarly, Alameda showed a sizable earnings impact for this sample ($2,220), as it had for 
its main sample, although the effect was not statistically significant (perhaps because of a small sample 
size). However, Alameda did not substantially reduce AFDC payments for this sample (it had a 
somewhat larger effect for the main sample). Tulare produced no earnings gains or welfare savings 
for this group (although it achieved earnings gains in year 3 for the main sample). 



The Riverside Case Management Experiment 

• In Riverside, GAIN'S already large impacts on earnings and AFDC 
payments were not improved for registrants who were assigned to case 
managers with smaller-than-normal caseloads* 

A special study was conducted in Riverside to test whether assigning registrants to staff with 
smaller caseloads, and allowing staff to monitor them more closely and work with them more 
intensively, would produce larger impacts on earnings and AFDC. Using random assignment 
procedures, experimental and case managers were divided into two groups: an "enhanced" group and 
a "regular" group. The average registrant-to-staff ratio in the enhanced group (53 to 1) was about half 
as large as the ratio for the regular group (97 to 1). 

Both the enhanced and regular experimental groups obtained large gains in earnings and large 
reductions in AFDC, but, contrary to what had been expected, these impacts were not greater for the 
enhanced group. These findings suggest that there may be little advantage to operating a GAIN 
program - at least one like Riverside's - with caseloads substantially below 100 registrants per case 
manager, and that keeping them in the moderate range of about 100 to 1 may be one way of containing 
program costs without jeopardizing program effectiveness. 



Findings on Program Costs for AFDC-FGs 

This study calculated several different types of cost estimates, including: the county welfare 
department's average expenditure per experimental; the total GAIN cost per experimental, which adds 
to the welfare department cost the average expenditures by schools and training providers for services 
provided to GAIN participants as part of the GAIN program; and the net cost (or net investment) per 
experimental. Net cost per experimental is the total public expenditure on employment-related 
activities per experimental - for post-GAIN activities as well as the total GAIN cost — minus the 
public cost of (non-GAIN) services to controls. Net cost is the cost measure used in the benefit-cost 
analysis, discussed later in this summary. All cost estimates cover a time horizon of five years after 
orientation (in order to capture long-term participation in GAIN activities and to be consistent with the 
benefit-cost analysis), and are expressed in 1993 dollars. 

• For all six counties combined, county welfare departments spent an average 
of $2,899 per experimental within the five years after orientation* 

Table 6A summarizes the average county welfare department expenditure for each of the six 
counties. Four of the six (Butte, Riverside, San Diego, and Tulare) spent between $2,000 and $2,700, 
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while the remaining two counties (Alameda and Los Angeles) spent about $4,000 or more. Across 
the six counties, about 60 percent of these expenditures were on activities that could be classified as 
case management (including conducting orientations, appraisals, and assessments; assigning registrants 
to activities; arranging for support service payments; responding to noncompliance; etc.). Among the 
other welfare department expenditures were the costs of conducting (or subcontracting the operation 
of) job club sessions and supervising individual job search activities, paying schools to provide extra 
monitoring and attendance data (to help the welfare department measure compliance with GAIN'S 
participation mandate), and paying for child care and other support services (e.g., for transportation 
and such ancillary items as books, tools, and uniforms). 

• The total five-year cost of GAD^ (counting welfare department and other 
agencies' costs for serving GAIN participants) was $4,415 per experimental- 

The total cost of GAIN per experimental is the sum of the GAIN-related expenditures of the 
county welfare department and other agencies. Non-welfare agencies - adult schools, community 
colleges, and other organizations - provided the education and training for GAIN registrants who 
were assigned to basic education classes, vocational training, and post-secondary education to meet 
their participation obligation, or who were participating in approved self-initiated activities begun prior 
to entering GAIN. Thus, the expenditures made by the non-welfare agencies to serve GAIN 
registrants are considered to be GAIN-related costs, even though they were not controlled directly by 
the county welfare departments. For all six counties combined, these expenditures averaged $1,515 
(Table 6A). Adding these GAIN expenditures to those made by county welfare departments ($2,899) 
yields the total GAIN cost of $4,415 per expei .mental. 

• GAIN expenditures were heaviest for job search, basic education, and 
vocational training and post-secondary education* 

The pie charts in Table 6 show how this six-county total cost per experimental was distributed 
across the key components of GAIN. The first chart (Table 6C) illustrates that the cost to the welfare 
department of processing registrants through the orientation and appraisal stages of the program 
(including following up on those who failed to attend their scheduled orientation sessions), plus the cost 
of assessments, accounted for about 17 percent of the $2,899 average welfare department GAIN cost, 
while expenditures on registrants assigned to job search activities and basic education (ABE, GED, 
or ESL activities) each accounted for about one-quarter of those expenditures. (Again, this includes 
the cost of the case managers' effort to monitor attendance and progress, arrange support services, 
follow up on nonattenders, etc., for these two activities.) Another 8 percent was spent on child care, 
and 12 percent was spent on other support services (transportation and ancillary services). It is 
important to note that, across all six counties, the average cost of GAIN child care per experimental 
would have been higher if the research sample had been composed mostly of parents with younger 
children, a group *at has a greater need for child care. For those with schoolage children, GAIN 
activities were often scheduled to take place while the children themselves were in school. Also, those 
whose youngest child was a teenager (up to about one-quarter of the research sample in some counties) 
would not have been eligible for GAIN-funded child care. 

The second pie chart (Table 6D) shows the distribution of total GAIN costs, i.e., after adding 
in the expenditures by other agencies providing the education and training received by GAIN 
participants while they were enrolled in GAIN. It shows that of the total average GAIN cost ($4,415), 
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three-quarters is accounted for by expenditures on registrants assigned to job search activities (16 
percent), basic education activiti(5S (31 percent), and vocational training and post-secondary education 
(27 percent). 

• The total cost of GADV varied widely by county, ranging from under $4,000 
per experimental in four counties (Butte, Riverside, San Diego, and Tulare) 
to almost $6,000 or more in two counties (Alameda and Los Angeles)* 

Four counties - Butte, Riverside, San Diego, and Tulare - had an average total GAIN cost 
(including welfare department and non- welfare agency expenditures) in the range of about $3,0(X) to 
$4,(X)0, while Los Angeles spent almost $6,0(X) per experimental and Alameda, more than $6,6(X). 
GAIN costs were lowest in Riverside ($2,963) owing, to an important extent, to Riverside 
experimentals' quicker departures from the GAIN program and their shorter length of participation, 
on average, in education and training activities in that county comparejd to experimentals in other 
counties. The unusually high costs in Alameda and Los Angeles (both of which served only long-term 
welfare recipients) are attributable to a combination of factors, including their experimentals' relatively 
long lengths of stay in GAIN and heavy use of education and training activities. In Los Angeles, this 
high usage was mostly in basic education activities, while in Alameda it extended to vocational training 
and post-secondary education as welL Longer participation in activities also produces greater 
expenditures for support services. 

• The average net cost of all GAIN and non-GAIN services per experimental 
was $3,422 for all six counties combined, but varied widely across the 
counties* 

Net costs are key to determining whether GAIN has been a cost-effective investment from the 
perspective of government budgets. They represent the difference between the five-year average total 
cost per experimental (including public expenditures on experimentals who participated in non-GAIN 
employment and training activities after leaving GAIN) and the average cost per control for non-GAIN 
services. The government's net cost per experimental for the six counties combined is thus obtained 
by subtracting the total cost per control ($1,472) from the total cost per experimental for GAIN and 
non-GAIN activities ($4,895), which yields $3,422 (after rounding). This number is presented in the 
last column of Table 6B. These costs were largest where the cost of GAIN itself was highest ~ in 
Los Angeles ($5,789) and Alameda ($5,597) — and lowest in Riverside ($1,597) and San Diego 
($1,912). 



Benefit-Cost Findings for AFDC-FGs 

The benefit-cost analysis addresses three questions: Are welfare recipients financially better or 
worse off as a result of the GAIN program? Is the government's net investment in services for the 
experimental group offset by subsequent budget savings? Does society as a whole come out ahead or 
behind as a result of the program? The analysis takes into consideration GAIN'S effects on earnings, 
AFDC payments. Food Stamps, and Unemployment Insurance payments, fringe benefits, taxes, Medi- 
Cal (i.e.. Medicaid) payments, administrative costs for AFDC and other transfer programs, and the 
net cost of employment-related services. It does not formally incorporate intangible positive or 
negative effects of the program, such as the increased sense of pride or feelings of stress or loss of 



time with their families that registrants might have felt in substituting work for welfare, or any 
enhancement of their self-esteem from obtaining a GED or other education credential through the 
GAIN program. The analysis also assumes that no displacement of other workers occurred as a result 
of employment gains for experimentals, because the displacement effects could not be measured. 

The benefit-cost estimates presented in this summary cover the five years after GAIN 
orientation, a time frame similar to the one used in most previous MDRC evaluations of welfare-to- 
work programs. (Because a full five years of follow-up data were not available for earnings, welfare 
payments, and other outcomes, the overall benefit estimates include some projected values, up to two 
years for some sample members but less than that for most.) It should be noted, however, that this 
probably is a conservative estimate, since five years is nof likely to be long enough to capture the total 
effects of GAIN. 

• In five of the six counties, experimentals, on average, were better off 
financially as a result of the GAIN program. 

As shown by the impact analysis, GAIN increased the earnings of experimentals in most 
counties. The measured and projected earnings gains and their associated fringe benefits constitute 
the primary financial gain from the standpoint of experimentals (referred to in benefit-cost analyses 
as the "welfare sample perspective"). However, these gains were offset to some extent by reduced 
AFDC payments and other transfer payments. 

Nonetheless, GAIN experimentals - with the exception of those in Los Angeles - experienced 
a net financial gain as a result of the program, averaging $923 per experimental for the six counties 
combined over the five-year period, as shown in Figure 2 A and Table 7. (The average net gain equals 
$1,420 when Los Angeles is excluded.) In Los Angeles, experimentals' losses in transfer payments 
(especially AFDC payments) exceeded their measured earnings increases, leaving them with a net loss 
overall of $1,561. (Any effect GAIN may have had on "off the books" earnings is not considered in 
this analysis.) In all other counties, experimentals realized an average net gain of between $948 in 
San Diego and $1,900 in Riverside. It is noteworthy, however, that in Tulare this positive result was 
achieved with a smaller earnings increase and a smaller reduction in AFDC payments compared to the 
other counties. In contrast. Riverside's results, compared to all of the other counties, reflect both a 
large increase in earnings and a large reduction in welfare payments - in other words, a greater 
substitution of work for welfare. 

• From the standpoint of the government budget, GAIN also produced 
economic "^^ins that exceeded costs in two of the six counties (Riverside and 
San Diego^ third county (Butte) led to the government budget "breaking 
even," 

From the "government budget perspective,' the gains of the program include reduced AFDC 
payments, reductions in other transfer payments, reductions in transfer program administrative costs, 
and the increased taxes paid by experimentals. The net expendimres for GAIN and non-GAIN services 
constitute the net costs to the government. Overall, the results for tills perspective - which sets a 
tough standard for programs to meet - are mixed, as Figure 2B and Table 7 show. Average costs 
incurred by the government exceeded savings per experimental by $3,054 in Alameda, $3,442 in Los 
Angeles, and $2,261 in Tulare. There was a moderate net gain (i.e., savings and increased tax 



-xUv- 



FIGURE 2 

GAIN'S BENEFIT-COST RESULTS FROM THE WELFARE SAMPLE AND 
GOVERNMENT BUDGET PERSPECTIVES FOR AFDC-FGs (SINGLE PARENTS) 
WITHIN FIVE YEARS AFTER ORIENTATION (IN 1993 DOLLARS) 



A. From the Welfare Sample Perspective 
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B. From the Government Budget Perspective 
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TABLE 7 

GAIN'S BENEFIT-COST RESULTS FOR AFDC-FGs (SINGLE PARENTS) (IN 1993 DOLLARS) 



Estimated Net Gain or Loss (Net Present Value) per Experinnental 



Sample and County 


Welfare 
Sample 


Govemment 
Budqet 


Society 


Return to 
Govemment Budget 
per Net Dollar Invested 


Full sample 










Alameda 


1090 


-3054 


-2103 


0.45 per $1 


Butte 


1585 


54 


1452 


1.02 per$1 


Los Angeles 


-1561 


-3442 


-5046 


0.41 per$1 


Riverside 


1900 


2936 


4458 


2.84 per $1 


San Diego 


948 


767 


1649 


1.40 per $1 


Tulare 


1577 


-2261 


-819 


0.17 per$l 


All counties (a) 


923 


-833 


-67 


0.76 per $1 



Registrants determined 
not to need basic education 

Alameda 5328 

Butte 4702 

Los Angeles -2826 

Riverside 3235 

San Diego 2925 

Tulare 673 



-6041 
-3955 
2892 
3576 
2610 
-2812 



-904 
621 
-11 
6328 
5235 
-2163 



0.16 per $1 
-0.30 per $1 
2.15 per $1 
4.36 per $1 
3.95 per$1 
-0.24 per $1 



Registrants determined 
to need basic education 

Alameda -1199 -2011 -3299 0.60 per $1 

Butte -820 4816 3656 2.71 per$1 

LosAngelec -1162 -4755 -5941 0.26 per $1 

Riverside 1111 2444 3246 2.24 per $1 

San Diego -968 -759 -1590 0.72 per $1 

Tulare 2333 -2082 45 0.30 per $1 

NOTES: The net present value from the societal perspective is estimated by summing the net present value from the 
perspective of the government budget (minus employers' share of payroll taxes) plus the net value of output produced by 
registrants in unpaid work experience positions. 

(a) In the all-county averages (included for the full sample only) . the results for each county are weighted equally. 
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revenues exceeded net costs) in San Diego ($767), and a quite large net gain in Riverside ($2,936). 
In Butte, GAIN resulted in the government budget breaking even (with a slight net gain of $54). The 
losses in Alameda and Los Angeles to ar, important extent reflect the comparatively high net 
expenditures on employment-related services per experimental, especially for education and training 
activities. On average, across the six counties, the GAIN program incurred a net loss to the 
government budget of $833 vv^ithin a five-year time horizon. 

One can also consider the cost-effectiveness of the GAIN program from the standpoint of the 
government budget by estimating the value of budgetary savings and tax increases per dollar of 
investment (i.e., per dollar of net costs). This measure is called return to budget per net dollar 
invested. An average gain of more than $1 means that the program brings" in more than a dollar's 
wortli of additional revenues and savings for each additional dollar spent on employment-related 
services to experimentals; an average return that is less than $1 implies a net loss for the government. 

Riverside's program produced $2.84 in increased revenues and savings for every net dollar 
spent on experimentals, a substantial return to the budget. (If Riverside had operated GAIN solely 
with the higher caseload sizes assigned to staff in the "regular" case management group, its return to 
the government budget would have been higher than $2.84.) The program in San Diego and (to a 
slight extent) Butte also returned more than $1 in revenues and savings ($1.40 and $1.02, 
respectively). Alameda, Los Angeles, and Tulare returned less than $.50 per dollar of net costs; and 
the six counties combined returned $.76, on average. 

• Overall, three counties (Butte, Riverside, and San Diego) achieved a net gain 
from the societal perspective. 

The net financial gain or loss to "society as a whole" is approximated by summing the results 
from the welfare sample and government budget perspectives.^ As Table 7 shows, Butte, San Diego, 
and especially Riverside achieved a net financial gain from the societal perspective, and were the only 
counties to do so. In Alameda and Tulare, the government incurred a net loss but welfare recipients 
gained - a kind of trade-off that policymakers may or may not find acceptable. 

• The fmdings across the six counties point to GADSf's potential to produce net 
fmancial gains for both education subgroups. However, different strategies 
may involve important trade-offs between the welfare sample and 
government budget. 

For experimentals determined not to need basic education, Alameda (which served longer-term 
welfare recipients) stands out as having produced the largest net gain for the welfare sample ($5,328 
per experimental). At the same time, Alameda's average net cost per experimental in this subgroup 
was unusually high ($7,161, compared to less than $1,100 in Riverside and San Diego), in part 
because of its high net increase in experimentals' use of vocational training and post-secondary 
education. These expenditures, in combination with the absence of substantial reductions in AFDC 



^The results from another perspective - that of the taxpayer - were also calculated but were excluded 
from this summary because they were close to those of the government budget. They included a small 
additional gain from increased output from experimentals employed in unpaid work experience (PREP) jobs 
and excluded the employer's share of payroll taxes. 
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payments, resulted in a substantial net loss for the government budget ($6,041 per experimental), as 
shown in Table 7. Riverside and San Diego illustrate an alternative pattern: Although they placed 
much less emphasis on vocational training and post-secondary education, they too achieved a net gain 
for th: J welfare sample (in the range of $3,000 per experimental), although it was considerably smaller 
than in Alameda. Because their expenditures were lower, these two counties also produced a net gain 
for the government budget: by $3,576 in Riverside and $2,610 in San Diego (a return of $4.36 and 
$3,95, respectively, per net dollar invested). 

For experimentals who were determined to need basic education, GAIN resulted in a net gain 
from the welfare sample perspective in only two counties (Riverside and Tulare) and for the 
government budget in two counties (Butte and Riverside). Riverside was the only county of the six 
to produce a net gain for both of the basic education subgroups from both the welfare sample and 
government budget perspectives. 



Summary of Impact an d Benefit-Cost Findings for AFDC-Us (Heads of Two-Parent Families) 

• GAm produced earnings gains for the heads of two-parent families (AFDC- 
Us) that were about the same in year 3 as in year 2, and welfare savings that 
were somewhat lower. Butte had the most unpressive earnings impacts, 
which were large and sustained over time. 

Averaging across five counties (omitting Alameda because of a small sample size) yields three- 
year earnings gains of $1,111 per AFDC-U experimental group member (a 12 percent increase over 
the control group average) and three-year AFDC impacts of $1,168 (a saving of 6 percent relative to 
the average AFDC payments to controls). (See Table 8.) 

The results varied considerably by county. GAIN increased earnings in the three-year follow-up 
period in three of the five counties - Butte, Los Angeles, and Riverside. However, only in Butte did 
earnings impacts increase from year 1 to year 2; they then held steady from year 2 to year 3, reaching 
a total of $3,295 per experimental over the entire three-year period. 

Reductions in AFDC payments were found in four counties - Butte, Los Angeles, Riverside, 
and San Diego - although they were not statistically significant in Butte (possibly because of a small 
sample size). Riverside's welfare impacts were the largest: a saving of $2,064 per experimental over 
the three years, or 14 percent of the average payments to controls. Butte, Los Angeles, and San Diego 
were in a middle range, while Tulare produced no AFDC impacts. It appeared unlikely there would 
be much addition to total AFDC impacts after year 3 except in Butte. 

• GAIN had a positive impact on AFDC-U experimentals' rate of employment 
in year 3 in three counties (Butte, Los Angeles, and Riverside). However, 
it did not reduce the proportion on welfare. 

Table 9 indicates that across the five counties included in the AFDC-U analysis, nearly 45 
percent of experimentals had ever been employed in year 3, compared to 40 percent of controls, a 
difference of almost 5 percentage points. This impact was concentrated in Butte, Los Angeles, and 
Riverside. Although Los Angeles had the largest impact (10 percentage points on this measure), this 
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effect did not translate into a correspondingly large earnings gain, perhaps because the jobs were short- 
term, low-paying, or both. 

Table 9 also shows that GAIN had little overall effect on the proportion of AFDC-Us receiving 
AFDC in the last quarter of follow-up, although Butte did show a reduction (not statistically 
significant) of almost 5 percentage points. In fact, the proportion of both groups receiving welfare at 
the end of year 3 was high in most counties, exceeding 50 percent (and reaching 78 percent in Los 
Angeles). These levels are comparable to those found for the AFDC-FGs, which was not expected 
because AFDC-Us are typically considered to be more "job-ready" and shorter-term users of welfare. 
These patterns may partly reflect the fact that the AFDC-U samples in several counties included a 
relatively high proportion of registrants who were not proficient in English. This was especially so 
in Los Angeles, where they accounted for 83 percent of the research sample, many of whom were 
Southeast Asian refugees. 

• GAIN'S benefit-cost results for AFDC-Us show a large positive effect from 
the welfare sample perspective in Butte only, and a modest positive return 
on the government's investment in Butte and Riverside only. 

As suggested by the impact analysis, GAIN did not produce for AFDC-Us the same overall 
economic benefits from the welfare sample perspective that AFDC-FGs received, primarily because 
savings in AFDC and other transfers offset earnings gains to a greater extent. As seen in Table 10, 
the AFDC-U welfare sample incurred net losses in three counties (Los Angeles, Riverside, and San 
Diego) and net gains in two others (Butte and Tulare). However, only in Butte did AFDC-Us receive 
a large net gain from the program, $2,096. From the government budget perspective, only Butte and 
Riverside produced a net gain ($697 and $1,314, respectively). 



Policy Lessons 

In passing the GAIN legislation in 1985, California legislators launched an ambitious effort to 
change the terms and conditions of receiving AFDC, with the twin goals of helping welfare recipients 
become self-sufficient and reducing the financial burden of welfare on the government. The model 
itself was the product of a compromise between two groups in California that embraced both of these 
goals but differed in their beliefs about the type of program best suited to achieving them. One group 
of reformers initially favored a relatively short-term program of mandatory job search followed, for 
participants who did not find jobs, by unpaid work experience (or "workfare"). The other group 
favored a broader range of services, with a strong emphasis on education and skills training, as well 
as less onerous penalties for noncompliance than the financial sanctions advocated by the first group. 
The resulting GAIN model incorporates elements of both of these approaches, representing a 
significant departure from the simpler (mainly job search) lower-cost initiatives of the early 1980s - 
and a prelude to the tederal JOBS program, which, like GAIN, includes a reciprocal obligation and 
greater focus than earlier programs on education and training. 

Representing a bold leap in welfare reform - in ambition, complexity, and expense - GAIN 
started with its feasibility uncertain and its effectiveness unknown. Would it be operated as envisioned 
on a large scale? Would its performance beat the clear but modest successes of earlier welfare-to-work 
programs? What approaches for implementing it would work best? The GAIN evaluation findings 
that are now available offer some answers. 



TABLE 9 



GAIN'S IMPACTS ON RATES OF EMPLOYMENT AND WELFARE CASE CLOSURES 
AT THE END OF YEAR 3 FOR AFDC-Us {HEADS OF TWO-PARENT FAMILIES) 



Ever Employed in Year 3 On AFDC in the Last Quarter of Year 3 

County Experimental (%) Controls (%) Difference Experimentals (%) Controls (%) Difference 



Butte 


48.1 


41.9 


6.2 * 


47.9 


52.7 


-4.8 


Los Angeles 


35.8 


26.0 


9.8 *** 


78.4 


77.9 


0.5 


Riverside 


44.8 


40.2 


4.6 ** 


42.6 


40.9 


1.7 


San Diego 


45.6 


43.9 


1.7 


56.9 


57.2 


-0.2 


Tulare 


48.9 


48.4 


0.5 


60.4 


59.9 


0.5 


All counties (a) 


44.6 


40.1 


4.5 *** 


57.3 


57.7 


-0.5 



NOTES: Statistical significance levels are indicated as *** = 1 percent (the highest level); ** = 5 percent; * = 10 percent. 

Because of Alameda's small sample size for AFDC-Us, the estimates of its impacts are considered much 
less reliable than those for the other counties; therefore, the Alameda impacts are not included in this table. 

(a) In the all-county averages, the results for each of the five counties displayed in the table are weighted 

equally. 



TABLE 10 

GAIN'S BENEFIT-COST RESULTS FOR AFDC-Us (HEADS OF TWO-PARENT FAMILIES) (IN 1993 DOLLARS) 



Estimated Net Gain or Loss (Net Present Value) per Experimental 
Within Five Years After Orientation, by Accounting Perspective ($) 











Return to 




Welfare 


Government 




Government Budget 


County 


Sample 


Budget 


Society 


per Net Dollar Invested 


Butte 


2096 


697 


2568 


1 .22 per $1 


Los Angeles 


-621 


-2021 


-2748 


0.55 per $1 


Riverside 


-714 


1314 


466 


1.61 per $1 


San Diego 


-1949 


-86 


-1796 


0.96 per $1 


Tulare 


260 


-2939 


-2685 


- 0.08 per $1 


All counties (a) 


-186 


-607 


-838 


0.79 per $1 



NOTES: The net present value from the societal perspective is estimated by summing the net present value from the 
perspective of the government budget (minus employers' share of payroll taxes) and the net value of output produced by 
registrants In unpaid work experience positions. 

Because of Alameda's small sample size for AFDC-Us, the estimates of its impacts are considered much 
less reliable than those for the other counties; therefore, the Alameda impacts are not included in this table. 

(a) In the all -county averages, the results for each of the five counties displayed in the table are weighted 

equally. 



Operating GAIN as envisioned on a large scale 



GAIN'S ambitiousness derived as much from the scale of the project - in most counties, having 
been targeted (originally) toward all single parents on AFDC with schoolage children and heads of 
two-parent families - as from the complexity of the model itself. Nonetheless, all of the study 
counties — large and small — were able meet the challenge of implementing GAIN'S mixed service 
approach involving job search, basic education, training, and other services, along with its ongoing 
participation mandate and multi-step enforcement process. Funding levels did not permit Alameda and 
Los Angeles to enroll the full mandatory caseload, or the other counties to continue doing so 
(especially after the transition to JOBS, which expanded the share of the welfare caseload targeted for 
GAIN), but the program model envisioned by the California legislature was given a "fair test" during 
the main period of program operations covered by the evaluation, and it proved administratively 
feasible. 

Is GAIN more successful than past welfare-to-work programs, and for more disadvantaged 
welfare recipients? 

In establishing GAIN, the California legislature hoped to create a program that would surpass 
in effectiveness the primarily job search programs of the early 1980s, particularly with the more 
disadvantaged portion of the welfare caseload that had benefited less from such services. Overall, the 
results suggest that GAIN could meet this standard — average GAIN impacts were larger than those 
produced by these earlier programs — but that it did not do so uniformly. The results also show that, 
in one county, GAIN produced the most impressive results ever found for a large-scale welfare-to- 
work program. 

Moreover, GAIN'S pattern of impacts shows that the program could substantially increase the 
earnings of long-term recipients, but that here, too, the effects were not consistent across counties. 
Some counties had better results for advantaged groups, some for less advantaged. The absence of 
a more consistent, predictable pattern suggests that giving priority for enrollment into GAIN to 
particular segments of the welfare caseload may not yield effective results across all counties. 
Therefore, for the state as a whole, a more broadly focused strategy might be more effective. (Past 
welfare-to-work studies point to the same conclusion.) At the same time, the challenge remains to 
improve the consistency of GAIN'S effectiveness across a wide variety of subgroups. 

Do some approaches work better than others? 

Although GAIN is based on a uniform program model that all of California's counties must 
operate, county administrators have considerable authority — under California's state-supervised, 
county-operated welfare system ~ to shape the program's actual content. The GAIN administrators 
in the six study counties chose to implement the program in different ways. The most important 
dimensions of program variation included the use of basic education, vocational training and post- 
secondary education, and other strategies; the message conveyed to welfare recipients about 
employment; and the use of direct job development. This variation provided the evaluation with an 
opportunity to explore whether some of these alternative approaches generated better results than 
others. 

The role of basic education . The study's findings suggest (but do not prove) that some use 
of basic education - one of GAIN'S most innovative and expensive features — may contribute 
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importantly to the program's success, as its designers had hoped. (As previously discussed, such an 
effect in Riverside would have been indirect, since it did not come from an increase in measured skills 
gains or GED receipt.) At the same time, the findings caution that basic education offers m guarantee 
of success — even when it is extensively used (as in Alameda) or its quality is considered exceptional 
(as in San Diego). Although the study cannot point particular changes in the character of the 
education treatment itself that would enhance its effectiveness, the absence of large earnings impacts 
in four of the six counties for welfare recipients lacking basic skills suggests that attempting to get as 
many of these recipients as possible to attend basic education as their initial GAIN activity appears not 
to be the most productive strategy. It may also be that permitting very long stays in this activity 
without closely monitoring participation and progress, and without requiring participants to test 
opportunities in the labor market along the way, would weaken the contribution that basic education 
could make to GAIN'S overall success. In the absence of more convincing evidence of a payoff from 
maximizing the use of basic education, a more equal emphasis on upfront job sear'^h as well as basic 
education activities, in combination with other factors, could be a better way of serving those lacking 
basic skills. 

The role of vocational training and post-secondary education . For recipients who already 
possess a high school diploma or a GED and pass a literacy test, the GAIN model requires "testing 
the job market first" by participating in job search activities before moving on to more expensive 
vocational training or post- secondary education. Given this sequence, and the fact that many controls 
enrolled themselves in non-GAIN vocational training or post-secondary education (as did some 
experimental after leaving welfare), GAIN'S impact on the use of these activities was small in most 
counties- Thus, the evaluation can provide only limited evidence on the effects of increasing their use. 

Some evidence suggests (but does not prove) that greater use of vocational training and post- 
secondary education rruiy be an effective approach: Alameda produced the largest increase in the use 
of such activities by registrants not needing basic education and achieved a large earnings gain for 
them; it also got them better jobs (compared to employed controls). In addition, Alameda produced 
the largest overall financial gain for experimentals in that subgroup across the six counties, as 
measured by the benefit-cost analysis. At the same time, this strategy can also be costly from the 
standpoint of the government budget, with the financial return falling far short of the government's 
net investment per experimental in the not-in-need-of-basic-education subgroup, as was the case in 
Alameda. 

It is therefore an equally important finding that, for this subgroup, two other study counties 
(Riverside and San Diego) produced large earnings gains and welfare savings, and an overall net gain 
for both the welfare sample and the government budget, all without increasing experimentals' use of 
vocational training and post-secondary education (compared to their use by controls). Thus, other 
approaches can provide an alternative route to achieving desirable earnings and welfare impacts and 
may be more cost-effective (although they may not lead to higher-paying jobs). 

The "message" and emphasis on quick employment and job development . While GAIN'S 
job search, basic education, and vocational education and training might help a county achieve positive 
earnings impacts, these services are unlikely to be all that matter. Among the program's other 
features, the "message" about employment that staff attempt to convey to registrants while they are 
in all components, and the active use of job development to establish a close link to private-sector 
employers, may also be critically important. 



A program's employment message is an aspect of operating GAIN that transcends specific 
program components. As described earlier in this sunmiary (in the section on implementation 
findings), the content of that message can vary widely, from more strongly emphasizing the value of 
any job, even a low-paying job,>to encouraging participants to wait for (and prepare for) a better job. 
Yet, the very content of that message may be part of what determines whether participation in any 
given component will actually have a payoff in the labor market. Indeed, the finding that the best- 
performing county (Riverside) far more strongly a:id pervasively than all other counties advocated the 
value of any job points to the potential importance of the employment message, even to registrants 
assigned to education and training activities. Perhaps it contributed to Riverside's success by affecting 
how much effort registrants - across a variety of subgroups - made to look for a job, and how 
selective they were with regard to the kinds of jobs they would accept. 

Job development, whereby staff directly assist registrants in locating employment opportunities, 
also transcends program components and may be another aspect of operating GAIN that enhances the 
payoff derived from participating in a GAIN component. By offering those taking part in GAIN job 
search or education or training a direct link to employers (as Riverside did to a far greater extent than 
any other county), job development may increase participants' opportunity and incentive to apply in 
the labor market what they learn in GAIN activities. 

The case of Riverside; a combination of factors . No single implementation factor is likely 
to explain why one county performs better than another, and this appears to be the case in accounting 
for Riverside's unusually strong performance. For example, the available evidence suggests that 
Riverside's results appear not to be explained by differences in the background characteristics of its 
GAIN registrants or local economic conditions. Moreover, while it had some distinctive program 
features, along many dimensions the program was not unique. What most distinguished Riverside 
from the other counties ~ and, therefore, what might have contributed to Riverside's more favorable 
results — was its particular combination of practices and conditions: a pervasive employment message 
and job development efforts, more equal use of job search and education activities for registrants 
needing basic education, a strong commitment to (and adequate resources for) securing the 
participation of all mandatory registrants, and reliance on GAIN'S formal enforcement mechanisms to 
reinforce the seriousness with which it viewed the participation obligation. This constellation of 
practices was not found in any other county. 

If Riverside's success sets a new standard of achievement for welfare-to-work programs, and 
if a combination of program strategies explains its success, it is important to ask whether Riverside's 
overall approach or some of its distinctive strategies can be replicated elsewhere with the same success. 
On the one hand, the finding that Riverside produced similarly impressive impacts across each of its 
GAIN offices suggests that its approach and success can be replicated even when operated by different 
staff and in localities characterized by diverse labor market and local conditions. On the other hand, 
the variation in local conditions within Riverside County does not capture the greater variation that 
exists across counties. Thus, it is not a foregone conclusion that Riverside's approach - including 
its focus on more rapid employment and job development - would work in other types of localities, 
particularly in inner-city areas such as those found in Los Angeles and Alameda, or whether they 
would succeed in more rural, agricultural areas with persistently high unemployment, such as those 
found in Tulare. Also, at least in the inner-city areas, where the welfare population as a whole 
undoubtedly faces greater barriers to employment, a stronger employment focus may or may not help 
to improve their employment prospects. Also important is whether other combinations of practices can 
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produce results as good as or (by helping more recipients get higher-quality jobs) better than those 
found in Riverside - e.g., by instituting a strong job development component in a program 
emphasizing vocational education and training, or delivering a strong employment message in a 
program that (unlike Riverside) actually produces a greater net increase in (i.e., impact on) the use 
of vocationally oriented activities. These are important questions for future evaluation efforts. 

Would changing the incen tives to work produce better results? 

A.xr important to consider some of the limitations of GAIN. As previously mentioned 

GAIN, even operating at its best, was only moderately successful in moving people off welfare and 
out of poverty by the end of three years. This is probably because of conditions that transcend the 
GAIN program, such as the economic incentive for welfare recipients to take and keep jobs It is 
therefore important to ask whether GAIN'S effectiveness can be enhanced by other reforms now under 
debate or already instituted that aim to improve the financial payoff from working. Such strategies 
include increasing the EITC (as the federal government has recently done), and, at the same time 
increasing welfare recipients' awareness of this benefit (which this study found to be low among 
recipients in GAIN). Other strategies would include allowing welfare recipients to keep more of their 
earmngs and still collect AFDC (as recent legislation in California and in other states does) and 
improving access to medical care (which is under debate in Congress) and child care for the working 
poor. Whether these and other reforms can strengthen the payoff from GAIN (or JOBS programs in 
other states) remains an important open question. 
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THE SIX COUNTIES IN THE GAIN IMPACT STUDY 
AND THEIR SAMPLES (AT THE TIME THE SAMPLES 
WERE ENROLLED IN GAIN: MARCH 1988 THROUGH JUNE 1990) 



Alameda which includes the city of Oakland, has the largest welfare caseload of 
^nqTe parents (AFDC-FGs), and the second-largest caseload of heads of two-paren 
«s (ATOC Us), arr^ong counties in the San Francisco Bay area It was one o 
wo evaluatL counties that had a large inner-city -^'^^f^ P^P); f-^, ^.^^^ 
enrolled only long-term recipients, a practice that was consistent with the statutory 
reqTement for counties that did not have enough resources o serve all GAIN- 
eSerMore than 80 percent of both its AFDC-FG and AFDC-U GAIN registrants 
we e mino7i?ies; a large majority (69 percent) of its single-parent registrants were 
Sack and a substan^al proporJon (40 percent) of its heads of two-parent fam^ies 
we?e Indochinese. Alameda had the second-highest proport on of [f g'|trants who 
were determined "in need of basic education" (65 percent for AFDC-FGs and 81 
percent for AFDC-Us). The caseload size per case manager in Alameda was 
relatively low, about 75:1 . 

Butte a county in northern California, had by far the smallest welfare caseload of 
fhe counties studied and the largest proportion of non-minont.es (more than 85 
percenro AFDC FGs and about three-quarters of AFDC-Us). Although it enrol ed 
a b^oad c OSS section of its mandatory GAIN caseload, Butte appeared to have the 
feast disadvantaged AFDC-FG sample in the study, with the lowest rate of those 
determ ned -Mn need of basic education" (49 percent), the lowest proportion of long- 
termTecipLts (28 percent), and the second-highest proportion of registrants with 
"t S history (57 percent). Butte used an unusual ^^AIN -nta e proc^^^^^^^^^^ 
in order to keep caseload size per case manager relatively low (ScS.I), registrants 
were bloughttnto GAIN but were placed on waiting lists for up to several months 
until a case manager had an opening. 

Los Anaeles with about one-third of the state's caseload and a welfare population 
large^than all but a few states', was the other county that had a arge inner-cty 
welfare population and that enrolled only long-term recipients. As a resut Los 
Angeles had the highest relative proportion of recipients m the research sample who 
w4 determined "\n need of basic education" (81 percent for AFDC-hGs and 92 
percent for AFDC-Us). An unusually large proportion (32 percent o AFDC-FGs and 
83 percen of AFDC-Us) were not proficient in English. Los Angeles also had the 
sL^lest P oportion of AFDC-FGs with a recent work history (just 17 percent) and 
the sSnTsmal est proportion of AFDC-Us who had recently worked (32 percent) 
The h^he"st average age'almost 39 years for AFDC-FGs and 42 for AFDC-Us , and 
the highest proportion of minorities (nearly 90 percent for both AFDC-FGs and 
AFDC-Us) Nearly 60 percent of its AFDC-U population was Indochmese. Los 
Anqeles' program started later and was somewhat less fully developed than other 
coun fes' programs during the study period. Alone among the counties in California 
Los Anqeles had also contracted with a private-sector firm to conduct case 
management. ?This contract was terminated in 1993.) Its GAIN caseload per case 
manager (128:1) was the highest among the six counties. 
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TABLE 1 1 (continued) 



Riverside, a large county in southern California, which has both urban and rural 
areas, enrolled a broad cross section of its nnandatory welfare population, A 
substantial proportion of its registrants (60 percent for AFDC-FGs, two-thirds for 
AFDC-Us) were determined "in need of basic education." Approximately half of its 
AFDC-FG registrants were minorities, as were 57 percent of its AFDC-U registrants. 
While half of its AFDC-FGs had recent work experience, the rate was 72 percent for 
AFDC-Us, Owing to a special study of the impact of different caseload sizes, the 
average caseloads were about 53:1 (for one group of case managers ) and 97:1 (for 
the other group). 

San Diego, with the state's second-largest AFDC-FG caseload and the fourth-largest 
AFDC-U caseload, enrolled a broad cross section of its caseload in GAIN, About 60 
percent of its registrants were minorities, and well over half were determined "in 
need of basic education." The county's GAIN sample had the highest proportion of 
registrants who had recently worked - 59 percent among AFDC-FGs - and the 
second-highest among AFDC-Us (nearly 80 percent). It had the second-highest 
average caseload per case manager (103:1), 

Tulare was the only county of the six that had to operate GAIN in the context of a 
rural and highly agricultural, seasonal labor market. A high proportion of Tulare's 
GAIN registrants were determined "in need of basic education" (65 percent of 
AFDC-FGs and nearly three-fourths of AFDC-Us), About 40 percent of its 
registrants were Hispanic, the highest proportion of any county. It had an average 
caseload per case manager, about 100:1, 




CHAPTER 1 



INTRODUCTION 



This report is the eighth in a series on the effects of California's Greater Avenues for 
Independence (GAIN) Program, which the Manpower Demonstration Research Corporation (MDRC) 
is evaluating under contract to California's Department of Social Services (CDSS).^ It presents 
findings on the effectiveness of GAIN in moving recipients from welfare to work over a three-year 
period and on the program's benefits and costs. 

GAIN, which began operations in 1986, aims to increase employment and foster self-sufficiency 
among people receiving Aid to Families with Dependent Children (AFDC), i.e., welfare. Operating 
in all 58 California counties, GAIN is one of the most ambitious welfare-to-work initiatives in the 
United States. Among its most distinctive features is its emphasis on mandatory, upfront basic 
education - usually preceding or following job search efforts - for welfare recipients who lack eitlier 
a high school diploma or basic literacy skills in mathematics, reading, or the English language. 

In July 1989, the GAIN program, with a few modifications, became California's version of the 
national Job Opportunities and Basic Skills Training (JOBS) Program. The basic service sequences 
were not changed, but, in accordance with the JOBS legislation (the Family Support Act of 1988), 
GAIN'S mandate was broadened to include single parents of children as young as age 3 (in addition 
to those whose children were all 6 years old or older) and, in some cases, the second parent in two- 
parent families. 

MDRC's previous reports on GAIN examined the program's implementation; its effects on 
employment, earnings, and welfare receipt over a two-year follow-up period in six counties; and (for 
a subsample determined to need basic education) its effects on basic skills and educational attainment. 
The two-year impact study found that, together, the GAIN programs in the six counties - Alameda, 
Butte, Los Angeles, Riverside, San Diego, and Tulare - produced statistically significant earnings 
increases and reductions in AFDC payments for the (mostly female) single-parent (AFDC-FG, or 
family group) registrants in the two years after individuals in the research sample entered the 
programs. The experimental group (i.e., those randomly assigned to be in the program) earned 21 
percent more, on average, than the control group (which could not enter GAIN), and received 6 
percent less in AFDC payments. Moreover, in the second year, the impact on earnings was twice the 
size of the first-year impact, and the reduction in welfare payments was about 23 percent larger. The 
effects varied substantially across the counties, with one county (Riverside) having had unusually large 
impacts and another county (Tulare) having had virtually no impacts. The other four counties also 



^MDRC's previous reports on GAIN are: John Wallace and David Long, GAIN: Planning and Early 
Implementation (1987); James Riccio, Barbara Goldman, Gayle Hamilton, Karin Martinson, and Alan 
Orenstein, GAIN: Early Implementation Experiences and Lessons (1989); Karin Maitinson and James Riccio, 
GAIN: Child Care in a Welfare Employment Initiative (1989); Stephen Freedman and James Riccio, GAIN: 
Participation Patterns in Four Counties (1991); James Riccio and Daniel Friedlander, GAIN: Program 
Strategies, Participation Patterns, and First-Year Impacts in Six Counties (1992); Daniel Friedlander, James 
Riccio, and Stephen Freedman, GAIN: Two-Year Impacts in Six Counties (1993); and Karin Martinson and 
Daniel Friedlander, GAIN: Basic Education in a Welfare-to-Work Program (1994). 
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produced significant impacts in the two years, although not always on earnings and AFDC payments, 
and not for all subgroups of GAIN registrants. The effects on the (mostly male) heads of two-parent 
families (AFDC-Us, or unemployed parents) were roughly the same in the second year as in the first 
year, although the earnings impacts tended to decline over the course of the second year. 

More recently, MDRC's special report on basic education in GAIN (1994) found that GAIN 
was successful in increasing receipt of a General Educational Development (GED) certificate 
(compared to GED attainment by the control group). ^ The impacts were relatively large in Tulare 
(19 percentage points) and Alameda (8 percentage points), small in Los Angeles and Riverside, and 
in the middle (4 percentage points) in San Diego. (Butte was not included in this study.) The study 
also analyzed whether GAIN increased the basic skills levels of welfare recipients as measured by a 
literacy test - the Test of Applied Literacy Skills (TALS). (The test was administered in English, so 
those individuals in the sample who were not proficient in English were not tested.) San Diego's 
GAIN program produced large and statistically significant impacts on TALS scores. No other county 
produced measurable impacts, and there was no impact for all counties combined, although small skills 
gains may have gone undetected. 

This report builds upon the previous analyses in several ways: by measuring GAIN'S labor 
market and welfare effects over a full three years of follow-up (and longer for groups — or "cohorts" 
— that entered the sample early); by presenting findings on a host of other economic and noneconomic 
outcomes based on new information from a survey of registrants two to three years after they became 
part of the research sample; by providing detailed information on program costs; and by including the 
results of a comprehensive benefit-cost analysis. As in the previous studies, this report presents 
separate impact findings for each of the six counties, recognizing that the program's effects may have 
varied because of differences in the way the counties chose to implement GAIN as well as differences 
in the demographics of their caseloads and in local economic and other conditions. These alternative 
approaches have themselves been fostered by the manner in which California's welfare system is run: 
Each county administers its own welfare agency under the supervision of CDSS. Thus, county 
administrators can exert significant control over the day-to-day operation of the program and the 
emphasis placed on different implementation strategies. Through a comparison of the six research 
counties, the previous reports began to examine whether differences in the counties' implementation 
practices and conditions contributed to their differences in program impacts. This report continues that 
analysis using the three-year follow-up data. However, for reasons discussed below, this type of 
assessment cannot be of the same level of rigor as the determination of whether or not GAIN was 
effective within each county. 

It should be noted that the results presented in this and the previous reports reflect the 
accomplishments of GAIN largely as the program was implemented in the six counties from the late 
1980s through 1991. (The study sample was enrolled in GAIN between March 1988 and June 1990.) 
Because, naturally, these programs have revised some of their operating strategies over time, the 
results do not necessarily reflect what the effects of GAIN would be today in those same counties. 

Results from the GAIN evaluation continue to be important for other states and the federal 
government because little other information is available on the impact and cost-effectiveness o * a large- 



^This credential is given to those who pass the GED test and is intended to signify knowledge of basic 
high school subjects. 
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scale welfare-to-work program that puts a major emphasis on upfront basic education in addition to 
job search and a range of vocational training options.^ Also, California includes about one-sixth of 
the nation's AFDC population, and GAIN accounted for a large share (almost 13 percent) of the 
federal government's total JOBS spending for fiscal year 1993. Furthermore, over 26 percent of all 
federal and state expenditures on AFDC in the United States were spent in California in that year. 
(The rate was 29 percent in February 1994.) Thus, California's experiences are particularly important 
in the continuing national debate over welfare reform. 

In its emphasis on basic education ~ and on serving longer-term welfare recipients - GAIN 
is similar to the JOB.S programs in many other states. However, though broadly relevant, the GAIN 
model differs substantially from many other states' approaches. In particular, GAIN'S highly specific 
sequences - including, in varying arrangements, job search, basic education, and other education and 
training activities ~ are unusual. More typically, welfare recipients begin the JOBS program in other 
states with an in-depth assessment of their needs and interests, and they are permitted greater choice 
over their initial activity assignment."^ Also, during the time the sample in this study entered GAIN,^ 
and for part of the follow-up period for this evaluation, most California counties enrolled the full 
GAIN-mandatory caseload, in contrast to the emphasis in many other states on serving volunteers first. 
Finally, California's AFDC grant levels are among the highest in the nation.^ Grant levels can affect 
work incentives and the relationship between work and welfare in a number of ways: High grants can 
reduce the relative attractiveness of low-paying jobs, but they also allow people to work and still 
remain on welfare, which, in certain cases, can increase work incentives. A state's grant levels may 
thus affect a program's impacts by hindering or reinforcing a program's efforts to move recipients into 
jobs and off welfare. 

L The GAIN Model 

The GAIN model begins at the county welfare department's Income Maintenance office. 
(Figure 1.1 illustrates the basic sequences in simplified form.) Here, when determining initial or 
continuing eligibility for welfare, the staff register GAIN-mandatory AFDC applicants and recipients 
for the program, and offer to register recipients who are GAIN-exempt but might wish to volunteer 
for the program. As indicated above, the pre-JOBS rules defining mandatoriness for GAIN exempted 
single parents with children under the age of 6, a group that accounts for about two-thirds of all single- 
parent AFDC recipients. No such exemption existed for the heads of two-parent families. 

After registration, eligibility workers refer new registrants to the GAIN office for orientation 
and appraisal. At orientation, the opportunities and obligations of the program are explained, and the 
registrant takes a basic reading and mathematics test. As part of the appraisal interview, the assigned 



^Most of the programs evaluated prior to JOBS emphasized primarily job search and subsidized work 
experience. See Gueron and Pauly, 1991. 

'^See, e.g., Hagen and Lurie, 1992; Lurie and Hagen, 1993. 

^Entry into the research sample (i.e., random assignment) began in March 1988 (in Butte) and ended in 
June 1990 (in Tulare). 

^In California, the basic AFDC grant for a family of three was $607 in January 1994, which was reduced 
from $624 in Januarj' 1993 and $663 in January 1992. Grant levels are higher only in Alaska, Hawaii, 
Connecticut, and Vermont. 



case manager reviews the registrant's background characteristics, including circumstances that might 
prevent her or (much less commonly) him from participating in GAIN. The registrant is then either 
referred to a GAIN activity or deferred (i.e. , temporarily excused from participating). GAIN'S support 
services, such as child care and transportation, are arranged at this time if the registrant needs them 
to take advantage of the program's activities.^ Participation in GAIN is expected to continue until 
the individual finds employment, leaves welfare, or is no longer required to participate for other 
reasons. Failure to comply with program rales can result in a "sanction" (i.e., a reduction or 
termination of the monthly welfare grant). ^ 

As noted above, not all those who attend an orientation are expected to take part in a GAIN 
activity. GAIN'S regulations permit temporary' deferral from the participation requirement for those 
who have a part-time job, temporary illness, family emergency, or another situation that precludes 
attending an activity. Welfare recipients are also not required to remain registered for GAIN if they 
meet certain exemption criteria such as getting a full-time job (of at least 30 hours per week) that does 
not pay enough to make a person ineligible for AFDC or being chronically ill. These individuals are 
officially removed (i.e., "deregistered") from the program, as are those who leave AFDC entirely for 
employment or other reasons. Still others who are expected to participate but choose not to may be 
sanctioned. 

As shown in Figure 1.1, GAIN has two primary service tracks. Registrants who do not have 
a high school diploma or a General Educational Development (GED) certificate, score low on either 
the reading or mathematics part of the basic skills test,^ or are not proficient in English are 
determined by GAIN regulations to be "in need of basic education." They usually enter one of three 
basic education programs: GED preparation. Adult Basic Education (ABE), or English as a Second 
Language (ESL). Registrants on this track may elect to pursue job search assistance first, but must 
then enroll in a basic education class if they do not find a job. Alternatively, they may choose to 
participate in basic education first and then job search, or they may elect to attend job search and basic 
education concurrently. 

The second major track is for registrants who are determined "not in need of basic education" 
(i.e., they have a high school diploma or a GED, pass the literacy test, and are deemed to be proficient 



"^GAIN helps registrants find, and pays for, child care services for children who are under age 13 - 
assistance that continues for a one-year transitional period if the registrant leaves welfare for employment. 
(Under special circumstances, GAIN child c^e is also available for children age 13 and older.) GAIN also 
reimburses program participants for relevant public transportation costs (unless a car is essential) including 
transportation for their children to and from a child care facility. Participants may also receive assistance with 
program-related expenses such as tools and books. Finally, GAIN funds can be used to identify the need for 
counseling for personal or family problems that arise from or hinder participation or employment and to make 
an appropriate referral. For details on GAIN'S support services, see Riccio et al., 1989. 

^Prior to JOBS, registrants who were heads of two-parent families lost their entire grant if they were 
sanctioned, whereas single parents lost only the parent's (not the children's) portion of the grant. Under 
JOBS, the heads of two-parent families who are sanctioned similarly lose only the parent's share of the grant. 
(Both parents may be sanctioned if both are noncompliant.) The exact dollar amount of a sanction varied with 
family size and changes in grant levels over the years. In January 1993, when the welfare grant was $624 
per month for a family of three, a sanction would have reduced the family's grant by $120. 

^he screening test is the Comprehensive Adult Student Assessment System (CASAS) test, and a score 
lower than 215 on the reading or mathematics portion is a criterion for designating a person to be "in need 
of basic education. " 



in English). They are usually referred first to a job search activity. " Job search activities include 
job club - group training sessions in which participants learn basic job-seeking and interviewing skills 
- and supervised job search, in which participants have access to telephone banks, job listings, 
employment counseling, and other assistance under staff supervision.^^ Job search activities usually 
last for three weeks. 

A third track is available for registrants who began an education or training activity prior to 
attending an orientation and appraisal (and irrespective of whether their appraisal determined them to 
be in need of basic education). At the appraisal session, the registrant's case manager decides whether 
the activity furthers the registrant's employment goal and whether the goal is consistent with the types 
of jobs for which workers are in demand in the local labor market. If the decision is yes, the case 
manager may authorize the registrant to continue attending the program as a GAIN activity and to be 
eligible (for no more than two years) for GAIN'S support services. Such an activity is referred to in 
GAIN as "self-initiated" education or training. 

Registrants who complete their upfront activities without having found a job must participate 
in a formal assessment of their career plans and work out an individual employment plan. They are 
then referred to "post-assessment" activities intended to further their employment plan. Possible 
activities include vocational or on-the-job training, unpaid work experience (which in GAIN is referred 
to as PREP),^^ supported work,^"^ or other forms of education and training. For some individuals, 
a 90-day job search (which can be supervised or unsupervised and include job club activities and other 
services) follows the post-assessment activity. If this fails to lead to a job, registrants are assigned to 
a PREP activity and then assessed again and another activity is selected. 

In most of California's 58 counties, GAIN operates through a network of service providers in 
the community, with the welfare department at the center. Typically, the county welfare departments 
register people for GAIN, manage the overall program, provide case management, develop PREP 
positions, id, in some cases, conduct job clubs and other job search activities. With a few 
exceptions, the rest of the GAIN program functions and services are the responsibility of agencies 
outside the welfare department. For example, adult schools - and sometimes community colleges and 
other organizations - supply basic education services, often using state Job Training Partnership Act 
(JTPA) "8 percent funds" (i.e., funds set aside for education and, in California, a portion of which 
was earmarked specifically for GAIN participants). Community colleges, proprietary schools, regional 



^^Individuals who do not need basic education and who have a recent history of having left welfare 
because of employment can be referred directly to assessment. 

^^Some counties assign some individuals to unsupervised job search prior to an assessment. 

^^PREP (Pre-Employment Preparation) is unpaid work experience in a public or nonprofit agency. PREP 
assignments can be short-term, lasting up to three months, or long-term, lasting up to one year. The number 
of hours of the work assignment are determined by adding the recipient's grant (less any child support the 
noncustodial parent has paid to the county) and the Food Stamp allotment, and dividing that sum by the 
statewide average hourly wage. PREP work assignments cannot exceed 32 hours per week. 

^^Supported work is paid work experience, in a group setting, for participants with little work history. 
It is characterized by close on-site supervision, peer support, and gradually increased responsibilities. A 
closely associated activity is transitional employment, which provides less intensive supervised training in a 
work setting. Neither of these activities was used in the six research counties for the sample included in this 
smdy. 

-6- 



ERLC 



69 



occupational centers, and JTPA vendors typically provide vocational education and training. Also, in 
many counties, the local offices of the state's Employment Development Department (EDD) operates 
GAIN'S job club and other job search components. In addition, most counties rely on local child care 
resource and referral agencies (although to different degrees) to help registrants find child care and 
often to make arrangements with child care providers; frequently, the GAIN staff also take part in this 
process. 



II. The Research Counties 

The six counties in the study of GAIN'S impacts represent diverse geographical regions of the 
state, vary widely in local economic conditions and population characteristics, and constitute a mix of 
urban and rural areas. (See Figure 1.2 and Table LI.) They include three large, mostly urban, 
southern counties (Los Angeles, Riverside, and San Diego); one county in the Central Valley, a lural 
region dominated by agriculture (Tulare); a moderate-sized county in the San Francisco Bay area 
(Alameda, which includes the City of Oakland); and one northern county (Butte) that has the smallest 
population of the six counties. Two of the counties (Alameda and Los Angeles) include large inner- 
city neighborhoods, and all but Butte are home to sizable populations of recent Asian and Hispanic 
immigrants and refugees. 

Partly reflecting differences in their geography, funding levels, and the degree of dispersion of 
their welfare populations, two of the counties operated their GAIN program out of a single location 
(Alameda and Butte), while the others established several local GAIN offices (San Diego, with eight, 
had the most). The total GAIN caseload ranged from 2,531 in Alameda to 24,397 in San Diego at 
the end of December 1990 (which was six months following the completion of sample intake for this 
evaluation). 

Although the GAIN participants in these six counties were not strictly representative (in a pure 
statistical sense) of GAIN registrants in California as a whole, together they accounted for about one- 
third of the state's entire GAIN caseload in December 1990. (Over half of the entire state AFDC 
caseload lived in these counties, with 34 percent of all cases having been located in Los Angeles 
alone.) Thus, while the results of the evaluation are not generalizable to the state as a whole, they do 
provide a test of GAIN as implemented under a wide range of conditions found across California. 

All of the research counties began operating their GAIN program between January 1987 (Butte) 
and October 1988 (Los Angeles). (See Table 1.1.) During the period of random assignment (to be 
explained shortly), Butte, Riverside, San Diego, and Tulare operated a "universal" program by 



^'^The average statewide GAIN caseload in July 1990-June 1991 was 178,676 cases per month. As a 
result of decreased funding, this average fell to 164,253 cases per month in July 1991 -June 1992. In 
December 1990, approximately 27 percent of all AFDC cases statewide were registered for GAIN. By 
December 1992, this had declined to approximately 18 percent (14 percent of AFDC-FG cases and 35 percent 
of AFDC-U cases). According to estimates obtained from CDSS in Jime 1994, total federal, state, and local 
expenditures for GAIN (not counting "community resources," such as the substantial amount of JTPA and 
California State Department of Education monies earmarked for serving GAIN students but not controlled by 
CDSS) were almost $198 million in state fiscal year 1990-1991. They fell to almost $183 million in 1991- 
1992, and then to about $167 million in 1992-1993. 
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registering all welfare applicants and recipients whose participation in GAIN was mandatory. (As 
previously noted, others who were exempt from the participation requirement were allowed to 
volunteer.) In contrast, Los Angeles and, in almost ail cases, Alameda registered only long-term 
welfare recipients whose participation in GAIN was mandatory, in accordance with GAIN regulations 
that require counties to give priority to long-term recipients when funding constraints do not permit 
services for all eligible clients. Los Angeles registered only welfare recipients who had received 
AFDC for at least three consecutive years. Alameda began by registering mandatory individuals who 
had been receiving AFDC since 1980 but subsequently registered more recent welfare recipients. 
For the most part, however, its sample consisted of recipients who had been continuously receiving 
AFDC for more than two years. 

As will become apparent below, the different intake policies across the counties, along with 
differences in the general makeup of each county's local population, yielded research samples that 
varied markedly in their demographic composition. This is an important fact, which must be kept in 
mind when comparing the impacts of GAIN across the six counties. 

Table 1 . 1 presents trends in unemployment rates in each county during the period of random 
assignment (which began in some counties in 1988) as well as through the end of the follow-up period 
for this report (June through September 1993).^^ Overall, unemployment rates were generally 
increasing toward the end of the follow-up period, a pattern influenced by the state and national 
economic recession. Indeed, in four of the six counties (Butte, Los Angeles, Riverside, and Tulare), 
the average monthly unemployment rate exceeded 10 percent in the period from July 1992 through 
June 1993.^^ Tulare consistently had the highest unemployment rates, which remained at about 15 
percent for the three-year period from July 1990 to June 1993, and over 10 percent since July 1988. 
(A severe freeze in early 1991, which destroyed much of the crop in that largely rural and agricultural 
area, contributed to this rise in unemployment rates.) Alameda and San Diego had the lowest 
unemployment rates toward the end of the follow-up period, but there, too, the rates had risen over 
time. (Moreover, unemployment rates in Oakland, where most of Alameda's GAIN clients lived, were 
higher than for the county as a whole.) 

A somewhat different picture of local economic conditions emerges when an alternative measure 
- the annual rate of change in the number of county residents employed ~ is considered. (See Table 
1.1.) Over the course of the follow-up period (i.e., from July in the year the county began random 



^^Prior to the start of the evaluation, Alameda gave priority to long-term recipients, within both the GAIN- 
exempt and non-exempt groups, who volunteered for the program. After the start of the evaluation, only long- 
term recipients in the non-exempt group were given priority, whether or not they volunteered. 

^^As noted earlier, random assignment began first in Butte and was completed last in Tulare. Data 
collection for employment and earnings ended in June 1993, which was three years after the last person to 
come into the evaluation was randomly assigned. Data collection for welfare outcomes ended in June 1993 
in three counties and in September 1993 in the other three. A minimum of three years of follow-up data is 
thus available on all sample members. However, the earlier registrants entered the sample, the longer was 
the period of follow-up for them. 

^^The unemployment rates and number of county residents employed that are presented in Table 1 . 1 may 
differ somewhat from the numbers presented in a similar table in previous MDRC reports for the period 
before July 1992 because more complete information for those prior years became available to the agencies 
that collected the data. 
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assignment through June 1992), Riverside had the highest growth rate (an average increase of 4.9 
percent per year) on this measure, which may be indicative of better opportunities for finding jobs 
(although it also reflects a growing population overall). It is important to point out, however, that 
even in these counties, as Table 1.1 shows, the rate of growth was not even from year to year, and 
each of them experienced a net reduction in employed residents in some of the years. For example. 
Riverside's growth rate was highest in the first two years. Overall, average annual growth rates were 
lower in the other counties. Tulare experienced an average increase of 2.3 percent per year. San 
Diego had an average increase of 1.1 percent per year. Los Angeles had very little growth in the 
number of employed residents, while the rate was slightly negative for Alameda. 

Although the county variation on this measure does not correspond well with the pattern of . 
unemployment rates, the two measures together illustrate the more general point that the counties faced 
quite different local circumstances in operating their GAIN program, another consideration when 
comparing county impacts. 

IIL An Overview of the Research Design 

To test the effectiveness of GAIN in increasing welfare recipients' employment and earnings 
and reducing their use of AFDC, a random assignment research design was instituted in each of the 
six counties. All individuals who, during the period of sample intake, were designated at the Income 
Maintenance office as mandatory registrants for GAIN^^ and attended a program orientation at the 
GAIN office were randomly assigned to either an experimental group, which was eligible to receive 
GAIN services and was subject to the participation mandate, or to a control group, whose members 
were not eligible for those services - including GAIN'S child care services ~ and were not subject 
to the mandate. (See Appendix Figure A. 1 .) Members of the control group remained wholly excluded 
from the GAIN program for at least three years (i.e., the entire minimum follow-up period covered 
by this report) and, with some possible exceptions, for another two years as well.^^ The controls 
could, however, seek alternative services in the community on their own initiative. Later, both groups 
- which together make up the research sample for the study of GAIN'S impacts - were followed up. 
The differences in their employment, earnings, and welfare receipt represent the measured impacts - 
or effects - of GAIN. 

In some other studies of welfare-to-work programs, random assignment took place when people 
came to the Income Maintenance office, rather than later, at program orientation, as it did in the GAIN 
evaluation. Under the fornier type of design, the impact sample includes individuals who never show 
up at a program orientation as well as those who do, and thus fully represents the caseload of 
individuals referred to the program. When random assignment is placed later, at orientation. 



^^As noted above, the mandatory population was broadened under JOBS, but this report focuses on the 
groups considered mandatory for GAIN under the pre-JOBS mles - i.e., single parents whose youngest child 
was 6 or older and the heads of two-parent families. A special section of Chapter 4 examines GAIN'S effects 
(in three counties) on single parents who had a child under age 6. 

^^For the subsequent two years, controls were neither required nor encouraged to register for GAIN, 
although they could enter the program at their own insistence if openings were available. This policy was 
adopted to facilitate the estimation of GAIN'S impacts over a longer period of follow-up for early cohorts and, 
if feasible, for tlie full sample as well. 
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registrants who do not show up for the program - a potentially sizable group^^ - are not part of 
the research sample. Thus, the results cannot be directly generalized to the entire caseload of 
registrants referred from the Income Maintenance office. This issue, which is explored further in 
Chapter 4, is important when comparing the results of the GAIN evaluation with those of other studies. 

Table 1.1 shows that the random assignment period for the GAIN impact study started and 
ended at different times in each of the six counties. (Random assignment concluded when the number 
of people required for the research had been enrolled in the sample.) Butte, the smallest of the six 
counties, conducted random assignment for about two years, from March 1988 to March 1990, The 
process was shorter in the other counties, ending everywhere no later than June 1990, Overall, about 
55 percent of the research sample were registered prior to July 1989, the date of GAIN'S transition 
to JOBS. 

Random assignment began in each county sometime between 7 and 14 months after the county 
began operating GAIN. The lag between the program and random assignment start dates was intended 
to allow the counties some opportunity, prior to the study period, to address the inevitable problems 
associated with beginning a new program. Nonetheless, as indicated earlier, program procedures and 
policies have continued to evolve as administrators and staff refme their approaches and acquire more 
experience in operating GAIN. At the same time, these individuals have continued to face other major 
challenges, such as the transition to JOBS in July 1989 and the large reduction in state GAIN funds 
in 1991-1992, One consequence of the funding cutback was a reduction or, in some counties, a 
temporary suspension of the client intake process. Not only did this cause some disruption in program 
operations, but it also made it difficult to ensure that experimentals who left welfare would be subject 
once again to GAIN'S participation mandate if and when they returned to the rolls. Thus, for some 
registrants, GAIN'S participation mandate was less continuous, their long-term use of GAIN services 
was lower, and, hence, the total GAIN cost of serving them was less than if GAIN had operated as 
a fully funded program during the entire evaluation period. These circumstances should be kept in 
mind as part of the context for this report. 



IV. The Riverside Case Management Experiment 

An additional feature of the GAIN evaluation is a special study conducted in Riverside County 
on the effects of assigning GAIN registrants to case managers with different-size caseloads. One group 
of case managers was assigned half as many registrants as the other. Although the actual average ratio 
of registrants to case managers fluctuated over time, the 2-to-l difference was maintained throughout 
the random assignment period and for approximately a year thereafter. Furthermore, all case 
managers, as well as all registrants in the experimental group, were randomly assigned to either the 
higher or lower caseload group. 



Although the orientation "no-show" rate was not measured in the six counties discussed in this report, 
it was measured in seven of the eight counties included in MDRC's 1989 implementation report (Riccio et al. , 
Chapter 4). In that sample, nearly one-third of all mandatory registrants did not show up for an orientation 
and appraisal within six months of their scheduled orientation. By the end of the six-month follow-up period, 
roughly two-thirds of those who did not attend an orientation had either left welfare or were officially excused 
from participating in the program. 
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This special experiment was designed to test whether assigning registrants to staff with smaller 
caseloads, and allowing staff to monitor them more closely and work with them more intensively, 
would produce larger impacts on employment and earnings and larger welfare savings. These findings 
are presented in the separate sections of the impact chapters of this report. (Thus, except where 
specified, all findings for Riverside refer to the county as a whole - i.e., both groups combined.) 



V. The Research Sample 

The analyses in this report concern participation, impact, and benefit-cost findings for GAIN- 
mandatory registrants who were determined to be mandatory according to the rules in effect prior to 
July 1989, when JOBS rules took effect. Under the pre-JOBS rules, single parents were usually 
exempted from the participation mandate if they had a child younger than age 6. Thus, the research 
sample for this report (and the earlier reports on GAIN'S first- and second-year impacts) is composed 
of single parents (AFDC-FGs), most of whom had children no younger than age 6"^ and unemployed 
heads of two-parent families (AFDC-Us). (Under pre-JOBS rules, AFDC-U registrants were 
mandatory even if they had a child under the age of 6, and this remains true under JOBS rules.) 
Altogether, the research sample includes more than 33,000 experimentals and controls, approximately 
69 percent of whom are AFDC-FGs and 31 percent of whom are AFDC-Us. (About 22 percent of the 
AFDC-FGs and 31 percent of the AFDC-Us were randomly assigned to the control group, with the 
acaial proportions varying across the counties and over time in some counties. )^^ 

The impact findings cover a period of at least three years of follow-up for sample members. 
Impacts are also presented for an "early cohort" of each county's full AFDC-FG and AFDC-U 
samples. These registrants were randomly assigned early during the period of sample intake, making 
it possible to examine GAIN'S impacts for them in a fourth year of follow-up. However, these fourth- 
year impacts may not necessarily reflect those for a county's full research sample if the county's early 
and later registrants differed in their background characteristics, the labor market conditions they 
faced, the way GAIN was operated when they were in the program, and other factors. Therefore, the 
fourth-year findings included in this report should be interpreted more cautiously than the full-sample 
results. 

Some data were also collected for a supplementary sample of 1,820 AFDC-FG registrants in 
Riverside and 493 in Tulare who had children between the ages of 3 and 5 and who were GAIN- 
mandatory starting in July 1989 under the new JOBS rules. Altliough participation and cost data were 
not collected for this supplementary sample, data necessary for calculating GAIN'S three-year impacts 
on their employment, earnings, and welfare receipt were collected, and the results are included in a 
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^^As discussed below, the samples in most counties also include some registrants who did have children 
younger than age 6 if they were considered mandatory by virtue of already being away from their children 
for more than "brief and infrequent" periods of time, owing to school attendance, employment, or other 
reasons, as specified in the GAIN regulations. In Alameda, the proportion was much higher because of 
misclassification of some recipients. 

^^As explained below, a small portion of the sample (289 sample me^nbers) had to be dropped from the 
impact analyses primarily because of missing information on key identifying and background characteristics. 
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separate section of Chapter 4. 
supplementary sample. 



Except where specified, all tables in this report exclude this 



VI. Data Sources 

A. Administ rative Records Data 

For the impact analysis, data on welfare receipt and welfare payment levels, and on Food Stamp 
benefits, were obtained on all experimentals and controls from each county's computerized welfare 
payment records. Employment and earnings data and Unemployment Insurance (UI) benefit payments 
(which are included in the benefit-cost analysis) came from the computerized California State 
Unemployment Insurance Earnings and Benefits Records. These data were collected for a period that 
began up to two years prior to random assignment (depending on the county) through June 1993 
(September 1993 for the welfare and Food Stamps data in three counties). 

B. Registrant Survev Data 

The impact analysis also uses data from a survey of registrants to assess GAIN'S effects on a 
variety of other economic and noneconomic outcomes in four counties: Alameda, Riverside, San 
Diego, and Tulare. (See Appendix B for an assessment of the survey sample's representativeness of 
the full impact sample in these counties.) Each respondent was interviewed within two to three years 
after becoming a member of the evaluation's research sample. 

For the AFDC-FG analysis, the survey sample in each county included approximately 350 
control group respondents and, except in Riverside, approximately 340 experimental group 
respondents. Riverside had about double the number of experimental group members sur/eyed in 
order to ensure that a sufficient number of registrants from both its "regular" (i.e., larger) caseload 
group and enhanced" (i.e., smaller) caseload group would be represented in that county's survey 
sample. (See the above discussion of the Riverside case management experiment.) 

The survey also included a small sample from Los Angeles, but respondents in the control group 
there were determined not to be sufficiently representative of controls in the full impact sample to 



^In all of the counties, any person who, under the new JOBS criteria, became mandatory for GAIN (and 
who would not have been mandatory under the pre- JOBS criteria), and who attended a GAIN orientation 
session between July 1989 and the end of random assignment, was to be included in the supplementary 
research sample. In Los Angeles and San Diego, few if any individuals fitting this description attended GAIN 
orientation within the period of random assignment. In Butte, a small number did, and were randomly 
assigned; they were too few in number, however, to permit a reliable estimation to be made of GAIN'S 
impacts on them. In Alameda, as discussed below, a sizable number of registrants with children between the 
ages of 3 and 5 were enrolled in the main research sample rather than the supplementary sample because of 
a classification error. None of the counties enrolled an adequate number of AFDC-U "second parents'' (i.e., 
the spouse of the person defined as the family head) - a group that was also newly mandatory under the JOBS 
criteria - to justify conducting an analysis of GAIN'S impacts on them. 

^*The period covered by the survey ranged from 26 months (San Diego and Tulare) to 37 months (Los 
Angeles), on average, in the five counties where the survey was conducted. 

"Response rates ranged from 77.3 percent (San Diego) to 82.0 percent (Tulare) across the five counties 
where the survey was conducted. 
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permit a reliable comparison of outcomes for experimentals and controls. Thus, no impacts are 
estimated for Los Angeles using the survey data. However, some of the survey data on Los Angeles's 
experimentals (whose survey respondents were sufficiently representative of the county's full sample 
of experimentals) are used in the implementation and cost analyses. The survey was not conducted 
in Butte because of the evaluation's limited survey budget. 

C. Data on Registrants^ Characteristics and the Implementation and Cost of GAIN 

To describe the background characteristics of the experimentals and controls (such as their age, 
race or ethnicity, family composition, and education and training, as well as their welfare and 
employment history), the report uses information from the state's client information (or "GAIN-26") 
form. A few special categories were added to this form in the six counties for research purposes. 

The report also draws upon some of the main findings from MDRC's earlier studies cone Tiing 
the implementation of GAIN in the six research counties. These include findings on the experimental 
group's patterns of participation in GAIN activities. They are based on the experiences of a subsample 
of AFDC-FGs and AFDC-Us (referred to as the participant flow sample) and cover the first 1 1 months 
after each subsample member's date of random assignment. In Alameda and Los Angeles, these 
participation data were obtained from computerized tracking systems, making it possible to include in 
the participant flow sample all experimentals in those two counties. In the other four counties, 
participation data were collected manually by MDRC staff from program casefiles. Consequently, data 
were obtained for only a subsample of the experimental group in those counties, 

The report also uses new data from the registrant survey to extend the implementation analysis. 
This includes information on experimental' participation in GAIN activities after the 11 months 
covered by the program tracking data, and their participation in non-GAIN (i,e,, post-GAIN) activities, 
which some experimentals entered on their own after leaving the program or welfare. Also available 
for the first time is information on experimental' views and opinions of GAIN, and on issues 
concerning work and welfare in general. Data on the control group's participation in (necessarily) 
non-GAIN activities and their attitudes concerning work and welfare were also collected through the 
survey. The study used data from several other sources as well to help ascertain the ways in which 
the counties implemented the GAIN model, including responses to the MDRC Staff Activities and 
Attitudes Survey, which was administered to all GAIN staff twice in each county (one and two years 
after GAIN began),^*^ along with a series of in-depth, in-person interviews with program case 
managers and administrators. Finally, to estimate the costs and benefits of the program, the study uses 
fiscal and program participation data from the six counties, CDSS, the California Department of 
Education, the Chancellor's Office of the California Community Colleges, and numerous other 
sources, (These data sources are described in greater detail in later chapters where the findings from 
the analvses using them are presented,) 



^^In the four counties with manually collected data, information was obtained for a randomly selected 
subsample of GAIN experimentals - 920 AFDC-FGs and 519 AFDC-Us - who were randomly assigned 
between March 1988 and May 1989, Because random assignment continued beyond this period, these data 
do not reflect the participation patterns of later cohorts of experimentals. For further details, see Freedman 
and Riccio, 1991. 

^^Response rates for each wave of this survey ranged from 94 to 100 percent across the counties. 
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VIL Background Characteristics of the Research Sample 



The top panel of Table 1.2 displays selected demographic characteristics of the research 
sample^^ of AFDC-FGs in each county (with the experimental and control groups combined). 
The bottom panel presents the same information for the AFDC-U group. County differences in the 
characteristics of their research samples are important to note because they may have contributed to 
differences in registrants' participation patterns as well as differences in program impacts and costs. 
For instance, past research suggests that the effects of welfare~to-work programs tend to be different 
for recent applicants to welfare than for those already receiving welfare when they enter the program 
(although the pattern of effects for these groups has not been fully consistent across the programs 
studied). Educational background also matters, especially in a program such as GAIN, where the 
sequences of services received are intended to be different for registrants determined "in need of basic 
education" and those determined "not in need of basic education." Thus, county variations in these 
and other characteristics must be considered when comparing the counties' participation and impact 
results. 

Table 1.2 reveals some striking contrasts in the background characteristics of the counties' 
research samples. For example, unlike samples in all of the other counties, those in Alameda and Los 
Angeles include virtually no individuals who, at the time of their referral to GAIN, were AFDC 
applicants or short-term recipients. This reflects the special intake policies in those two counties, 
which were noted above. Furthermore, in the AFDC-FG group in the other four counties, the 
proportion of long-term recipients (who had received welfare for more than two years) ranged from 
28 percent in Butte to 58 percent in Tulare. Across the six counties, the proportion who had worked 
for pay during the two years prior to orientation ranged from 17 percent in Los Angeles to 59 percent 
in San Diego, and the proportion considered to need basic education ranged from 49 percent in Butte 
to 81 percent in Los Angeles. The counties also varied widely in racial and ethnic composition. For 
example, 12 percent of Los Angeles's sample were non-Hispanic whites, compared to 86 percent of 
Butte's. Also striking is the fact that almost one-third of the Los Angeles sample were considered to 
have had limited proficiency in English, compared to 5 to 17 percent of the sample in the other 
counties. 

Table 1 .2 also shows that the AFDC-FGs in each county's research sample include some single 
parents with children who were under the age of 6 at the time of orientation - a group that was not 
normally considered mandatory under the pre-JOBS criteria for GAIN. The proportion was as high 
as 31 percent in Alameda, and in the other counties ranged from 10 percent (Los Angeles) to 16 
percent (Riverside). Except in Alameda, the majority of these individuals appear to fall into a group 
who, under the pre-JOBS rules, were sometimes referred to as "soft mandatories"; they were not 
exempted from GAIN'S participation requirement because they were not personally providing the full- 
time care that their child received (e.g., because they were attending school or working part-time). In 



^^The research sample of 33,222 registrants shown in Table 1 .2 includes 289 cases that were not included 
in the impact analyses because Social Security numbers and/or AFDC case numbers were missing, or for other 
reasons. Dropping these cases from the impact analyses (Chapters 4 and 6) accounts for the slight variation 
between subgroup percentages in the demographic tables (Table 1.2) and those in the impact tables. 

^^he background characteristics of sample members included in the supplementary sample of single 
parents with children younger than age 6 are presented in Appendix Table A. 1. 

^^See, e.g., Friedlander, 1988; Friedlander and Hamilton, 1993. 
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Alameda, the unusually high proportion of sample members who had children under age 6 resulted 
from a coding problem. People who were mandatory for GAIN only under the new JOBS criteria 
(which took effect at the same time that random assignment in Alameda was beginning) were not 
distinguished in the county's automated data base from people who were mandatory even under the 
pre- JOBS rules. 

The higher proportion of single parents with pre-schoolage children in Alamada is an added 
reason for caution in comparing impact findings across the counties (although, as Chapter 4 will show, 
the employment and welfare outcomes for this group of experimenials and controls were not much 
different from those for single parents with older children). 

In contrast to the AFDC-FG group, the AFDC-U sample members were less likely to be long- 
term welfare recipients (except in Alameda and Los Angeles), more likely to have been employed in 
the prior two years (except in Alameda), and more likely to have been determined to need basic 
education, in part because of their more limited knowledge of English. AFDC-Us also include a 
higher proportion of heads of households of refugee families from Vietnam, Laos, and Cambodia as 
well as from other countries. Notably, more than one-half of the AFDC-U samples in Alameda and 
Los Angeles were Indochinese or members of other Asian groups. 

VIII. Explaining County Variation in Impacts: Some Limitations 

Although GAIN is based on a uniform program model that all of California's counties must 
operate, county administrators have considei^able authority to shape the program's actual content. As 
shown in previous MDRC reports (and as summarized in Chapter 2 of this report), the GAIN 
administrators in the six research counties chose to implement the program in very different ways. 
In part, their decisions reflected their different beliefs about the best ways to institute the GAIN 
legislation's ongoing participation mandate for welfare recipients and to achieve the program's twin 
goals of moving registrants into jobs and off welfare. 

This variation in implementation strategies provided the evaluation with an opportunity to 
explore whether some of these alternative approaches produced better participation and impact results 
than others. At the same time, as noted earlier, it is important to recognize thai this type of 
comparative analysis cannot be of the same level of rigor as the analysis of program impacts within 
each county. This is because registrants were randomly assigned to the experimental and control 
groups within each county, and not to the different county programs. To answer, with the same level 
of rigor, the question of how differences in implementation strategies affected impacts would have 
required sample members to have been randomly assigned to the various counties' programs (or to 
different types of treatment, as was done for the Riverside case management experiment). Only in that 
way would it have been possible to link with certainty any variation in impacts to those approaches 
rather than to other conditions that distinguished the programs. 

In the absence of such a design, county comparisons must be interpreted cautiously or they can 
lead to misleading conclusions about "what practices work best."^^ In particular, judgments must 



^^For further discussion of this issue in the context of an evaluation of a youth employment program, see 
Cave and Doolittle, 1991. 
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be made about the possible influence of a whole host of factors that might have affected a county's 
impacts before drawing any inferences about the role of any specific implementation practices. These 
include various characteristics of the local community in which the program was operated, and the 
types of individuals the program served. With these limitations clearly recognized, the present report 
will offer, in Chapter 8, an update of the 1993 report's analysis of whether implementation strategies 
influenced the counties' impacts, taking advantage of the longer period of follow-up that is now 
available for the employment, earnings, and welfare data, as well as information from the registrant 
survey, particularly on experimental-control differences in the use of employment-related activities. 



IX. An Overview of This Report 

The next chapter (Chapter 2) discusses the GAIN treatment. It summarizes the key 
implementation findings from previous reports and also presents estimates of longer-term participation 
in GAIN and non-GAIN activities, using a combination of data sources, including the registrant 
survey. In addition, the chapter estimates GAIN'S impact on the use of employment-related activities 
by comparing experimentals' average number of months of participating in them with ihe average for 
controls (who could enroll in non-GAIN activities in the community on their own). The chapter also 
presents new information on experimentals' perceptions of GAIN. 

Chapter 3 discusses estimates of the cost of employment-related services provided to 
experimentals and controls. For the experimentals, the average costs incurred by the county welfare 
agency and by non- welfare agencies (e.g., schools) for GAIN-related activities are isolated from each 
other, and from any costs incurred by non-welfare agencies in serving experimentals who enrolled in 
education and training activities after leaving welfare or GAIN. The chapter also presents the costs 
incurred by non-welfare agencies for providing education and training services to controls (which, by 
definition, were outside the GAIN program). It then estimates the "net" cost of all services received 
by the experimental group - i.e., the difference between the average total cost per experimental and 
the average total cost per control. Chapter 7 will compare this net cost to estimates of the economic 
benefits produced by GAIN to assess the program's overall cost-effectiveness. 

Chapters 4 and 6 present the three-year impacts of the GAIN "treatment" on registrants' 
employment, earnings, and welfare receipt. Chapter 4 presents results for the AFDC-FG group (the 
single parents), while Chapter 6 concerns the AFDC-U group (the heads of two-parent families). Past 
studies, including the report on GAIN'S two-year impacts, have shown that these two groups tend to 
have different patterns of labor market and welfare behavior, which produce different patterns of 
impacts from welfare-to-work programs. 

Chapter 5 takes a closer look at the employment and welfare experiences of the AFDC-FG 
sample, primarily using the registrant survey data. It compares the characteristics of jobs obtained by 
experimentals and controls, the job-seeking efforts of experimentals who were not working or were 
working only part-time, the reasons nonworkers did not look for work, the reasons some registrants 
gave for leaving and returning to welfare, and GAIN'S impacts on a variety of noneconomic outcomes 
that pertain to registrants' living conditions and quality of life. These analyses will help in interpreting 
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^^See, e.g., Gueron and Pauly, 1991. 
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some of the main impact findings reponed in Chapter 4 and the benefit-cost findings presented in 
Chapter 7. 

Chapter 7 presents estimates of the economic benefits of GAIN over the five-year period after 
orientation, using a combination of observed and projected estimates. Those benefits are then 
compared to what it cost the government (at the federal, state, and local levels combined) to serve 
experimentals, producing an estimate, for each county, of ihe program's cost-effectiveness from the 
government's perspective. The chapter also presents estimates of the net economic gain or loss from 
the perspective of welfare recipients, and from the perspective of society as a whole. 

The report concludes, in Chapter 8, with an assessment of whether differences in the counties' 
GAIN registrants, local labor markets, and strategies for implementing GAIN might help to explain 
the differences in their three-year impacts and benefit-cost results. 
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CHAPTER 2 



THE GAIN TREATMENT 



To inteqpret the results of the GAIN evaluation's impact and benefit-cost analyses, it is essential 
to understand how extensively the experimental group took part in GAIN activities, which activities 
they used most and least often, and how their levels of service use compared to that of controls, who 
could seek non-GAIN services on their own. These patterns are a key part of what is meant by the 
program "treatment" from the experimental group's perspective; as such, they drive GAIN'S costs in 
the short run, can influence program impacts on employment and welfare receipt, and help determine 
GAIN'S cost-effectiveness in the long run. This chapter examines these participation patterns, as well 
as key program implementation practices that also shaped recipients' experiences in GAIN. 

Earlier MDRC reports on GAIN have described in detail the experimental group's participation 
patterns within 11 months after orientation.^ Section I of this chapter briefly recaps some of those 
findings. Section II examines new data on the experimental group's longer-term participation in 
GAIN, u;>ing several sources, primarily the registrant survey, which (except in Butte)^ was 
administered two to three years after people attended GAIN orientation and entered the research 
sample. This is especially important in view of experimentals' substantial use of education and 
training, activities that can last a considerable amount of time. Indeed, earlier reports found that many 
participants were still in such activities at the end of the 11 -month follow-up period, meaning that 11- 
month estimates of the duration of participation would understate actual longer-term usage. Longer 
follow-up is also essential because GAIN'S ongoing participation mandate calls for registrants to 
participate in employment-related activities as long they continue to receive AFDC payments and, 
according to program guidelines, remain capable of participating (program resources permitting). In 
theory, therefore, participation could extend over a number of years and, as Chapter 3 will discuss, 
a full accounting of the cost of that participation requires that it be measured over several years. For 
this study, a period of five years was chosen for estimating the amount of participation (and for 
estimating costs and benefits). 

Understanding the experimental group's use of employment-related activities is key, but it is 
equally important to understand how much (if at all) GAIN increased the level of participation in these 
kinds of activities above and beyond what it would have been in the absence of the program. As 
discussed in Section III, GAIN'S net effect on participation has been determined by comparing 
experimental-control differences in participation in employment-related activities, using registrant 
survey data and other information. Understanding the magnitude of any such differences across 
various types of activities is crucial: If the control group got about as much of a particular kind of 
activity as did the experimental group, that activity - even if experimentals used it extensively - is 
unlikely to have contributed much to GAIN'S employment and welfare impacts or to have influenced 
its benefit-cost results (unless, of course, the quality of the services received by experimentals and 
controls was substantially different). 



^Riccio and Friedlander, 1992; Martinson and Friedlander, 1994. 

^As noted in Chapter 1, the registrant survey was not conducted in Butte because of the evaluation's 
limited survey budget. Thus, some of the participation estimates for Butte included imputations based at least 
partly on survey data from other counties. 
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Section IV briefly reviews other implementation findings from earlier reports, which concern 
differences in the counties' approaches to operating GAIN, e.g., in the kinds of "messages" staff 
emphasized about employment and GAIN'S participation obligation, and in the kinds of direct 
interactions staff had with registrants. Section IV also presents new data from the registrant survey 
on experimentals' perceptions of GAIN, while Section V discusses findings on experimentals' and 
controls' views of participation mandates. 

As the chapter will show, GAIN did have an impact on the use of employment-related activities, 
but it varied across the basic education subgroups and across counties. For AFDC-FG experimentals 
determined not to need basic education, the main effect of the program was to increase the receipt of 
job search services and, in some counties, vocational training and post-secondary education. 
(Alameda's impacts on the latter set of activities are particularly noteworthy.) For AFDC-FG 
experimentals in the subgroup determined to need basic education, GAIN produced an increase in 
participation in job search and basic education (ABE/GED and ESL classes). 

It must be stressed that the descriptions of county practices contained in this report are based 
on information collected no later than mid- 1991, and prior to that in most cases. This is the relevant 
information for describing the "treatment" experimentals got. However, the information may not 
necessarily portray the counties' current modes of operating GAIN. All of the counties have continued 
to revise their implementation strategies as they have acquired more experience in operating this very 
complex welfare-to-work initiative, and in response to changing funding circumstances. 

I. Experimentals^ Participation in GAIN Activities Within 11 Months After Orientation^ 

Table 2. 1 presents the findings on AFDC-FG experimentals' use of GAIN activities within the 
first 11 montlis after orientation, based on data collected directly from county casefile records. As the 
table shows, more than half of the group in five of the six counties participated in a GAIN job search, 
education, or training activity.'* Participation rates in these counties ranged from 51 percent in Los 
Angeles to 63 percent in Alameda. ITie sixth county - Butte - had a markedly lower rate (43 
percent), partly because it delayed assigning orientation attenders to case managers in order to limit 
the size of case managers' caseloads while still including as many people as possible in orientation and 



^This section is adapted from a previous report (Friedlander, Riccio, and Freedman, 1993). 

"hrhere are many ways to define and measure participation in welfare-to-work programs. The participation 
tables in this section of the chapter use a fairly simple indicator, defming "participation in any GAIN activity" 
as ever entering a job search, education^ or training activity within the 11 months following each person's 
GAIN orientation meeting, which was also when random assignment took place. Registrants were counted 
as having "ever participated" if they attended a GAIN activity at least once, although most orientation 
attenders stayed much longer than this. GAIN activities include those to which individuals were referred by 
program staff as well as those that were "self-initiated." (As noted in Chapter 1, the latter were activities that 
welfare recipients had already started before entering GAIN and were allowed to pursue as a way of meeting 
GAIN'S participation requirement.) Orientation, assessments, appraisals, or meetings with case managers were 
not counted as participation. This definition differs substantially from the one embodied in the federal 
regulations for the JOBS program but is consistent with MDRC's other reports on GAIN and its earlier reports 
on other welfare-to-work initiatives. 
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TABLE 2.1 

RATES OF PARTICIPATION IN GAIN ACTIVITIES AMONG AFDC-FG EXPERIMENTALS 
WITHIN 11 MONTHS AFTER ORIENTATION 



Sample and Los 

Participation Status Alameda Butte Angeles Riverside San Diego Tulare 



All experimentals 



Ever participated in any GAIN 














activity, excluding appraisal 










55.1 




and assessment (%) 


63.1 


42.5 


51.3 


60.1 


60.9 *** 


Ever deferred (%) 


46.2 


31.5 


48.9 


48.0 


64.4 


53.3 *** 


Ever participated in any GAIN 














activity or deferred for oart-time 














employment (%) 


68.8 


49.0 


58.1 


66.1 


72.1 


72.4 (a) 


Ever participated in (%) 














Job search 


26.4 


18.0 


11.9 


34.3 


29.6 


20.4 *** 


Basic education (b) 


38.5 


15.0 


36.8 


21.8 


19.0 


36.4 


GED 


13.6 


8.0 


6.8 


9.7 


6.9 


18.2 *** 


ABE 


23.9 


4.0 


19.4 


7.7 


9.7 


16.4 *** 


ESL 


2.0 


3.0 


12.3 


5.2 


3.6 


6.2 *** 


Self- initiated activity 


3 2 (c) 


10.0 


6.2 


13.3 


15.4 


7.6 


Assessment 


16.4 


11.5 


3.7 


1 .6 


1 1 .3 


19.6 *** 


Post— assessment activity 


17.3 (c) 


4.0 


1.1 


2.4 


8.1 


9.3 *** 


Any education or 














training activity 


53.0 


27.5 


43.8 


36.3 






Sample size 


602 


200 


3013 


248 


247 


225 


Experimentals who started 














any GAIN activitv (d) 














Participated in (%) 














Job search 


41.8 


42.4 


23.2 


57.0 


53.7 


33.6 *** 


Basic education (e) 


61.1 


35.3 


71.8 


36.2 


34.6 


59.9 *** 


Self-initiated activity 


5.0 (c) 


23.5 


12.2 


22.1 


27.9 


12.4 *** 


Post-assessment activity 


27.4 (c) 


9.4 


2.2 


4.0 


14.7 


15.3 *** 


Any education or 














training activity 


83,9 


64.7 


85.4 


60.4 


67.6 


81 .0 *** 


Sample size 


380 


85 


1545 


149 


136 


137 



SOURCE: Calculations using data from the MDRC participant flow study. 



NOTES: Distributions may not add to 100.0 percent because of rounding. 

A chi-square test was applied to differences across counties. Statistical significance levels are indicated as 
*** = 1 percent: ** = 5 percent; * = 10 percent. 

(a) A test of statistical significance was not performed. 

(b) Subcategory percentages may not add to the category percentage because participation in more than one 
component of basic education was possible. 

(c) Alameda registrants already in vocational education at orientation were coded as participating in vocational 
education instead of in self- initiated vocational education. This policy causes the post-assessment activity percentage, which 
includes vocational education, to be higher and the self-ir:itiated activity percentage to be lower than if the coding had been 
consistent with that in the other counties. 

(d) This sample includes only those experimentals who ever participated in any GAIN activity, excluding appraisal 
and assessment. 

(e) GED preparation, ABE, and ESL. 
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appraisal sessions. This waiting period usually lasted several months and delayed referral to the 
experimentals' first activity.^ 

While a substantial portion of the orientation attenders - ranging from 37 to 57 percent - did 
not participate in a GAIN activity, almost all of the nonparticipants were people who were not required 
to participate in GAIN activities by the end of the 11-month follow-up period. The vast majonty (80 
to 100 percent) of the nonparticipants were either no longer enrolled m the program (i.e., they were 
"deregistered") because they had gotten a full-time job, left welfare, were sanctioned, or met other 
specific criteria, or were temporarily excused from participating (i.e., they were "deferred") because 
of part-time employment, illness, or other reasons.^ Table 2.2 shows how frequently registrants were 
deferred for various reasons. The most common deferral reasons were: part-time employment, a 
medically verified illness, and a "severe family crisis." Interestingly, as shown in the top panel of 
Table 2.1, if part-time employment were counted as an "activity," the "ever participated" rate would 
climb to as high as 72 percent (in San Diego and Tulare). 

Table 2.1 displays the incidence of participation in each GAIN activity, calculated in two ways. 
The top panel presents these rates for all experimentals, including those who never started an activity. 
This approach is helpful for understanding the extent to which the entire sample received particular 
kinds of services. The bottom panel presents several participation rates for only those experimentals 
who ever participated in any GAIN activity. The latter measure is useful for comparing the mix of 
services among those who used these services. 

As Table 2.1 shows, job search, basic education, and self-initiated programs^ were the most 
heavily used activities in GAIN during the 11-month follow-up period, as would be expected given the 
GAIN model's particular service sequences (see Chapter 1). Within this time period, a much smaller 
proportion of experimentals had entered post-assessment activities, e.g. , vocational skills traimng, post- 
secondary education, and unpaid work experience (PREP). 

Another measure on Table 2. 1 combines all classroom-based education and training into a single 
category "any education or training activity." This measure includes participation in basic education, 
self-initiated education and training, and post-assessment education and traimng. It excludes 
participation in on-the-job training (OJT) and PREP activities, both of which entail performing a job 
rather than classroom training; it also excludes participation in job search activities. The table shows 



5Butte administrators set a limit of about 75 GAIN registiants per case manager, while saU scheduling for 
orientation all welfare applicants and recipients who met GAIN'S eligibility requirements. Because the rate 
of intake into GAIN exceeded the capacity set for case managers, experimentals who attended onentation were 
routinely placed on a waiting list for assignment to a GAIN case manager and were not contacted by th.e GAIN 
staff until a case manager slot became available. 

*See Riccio and Friedlander, 1993, p. 27. ^ u ■ j .■ 

^With few exceptions, self-initiated activities involved vocational skills traimng and not basic education. 

8The counties varied significantly in the proportion of registrants using particular components. 
Experimentals in Butte, Riverside, and San Diego used job search activities at a higher rate than any other 
single activity Basic education was the second most commonly used GAIN activity m those counties. Just 
the opposite pattern occurred in Alameda, Los Angeles, and Tulare, where basic education was the leading 
GAIN component, followed by job search. (However, among those determined to need basic education, ,t 
was somewhat or much more commonly used than job search in all six counties.) 
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TABLE 2.2 

PATTERNS OF DEFERRAL FROM GAIN PARTICIPATION AMONG AFDC-FG EXPERIMENTALS 

WITHIN 11 MONTHS AFTER ORIENTATION 



Sample and 
Deferral Status 



All experimentals 

Ever deferred (%) 

Reason for first deferral (%) 
Employed 1 5 to 29 hours per week 
Medically verified illness 
Severe family crisis 
No transportation 
No child care 

Emotional or mental problems 
Legal difficulties 
Alcoholism or drug addiction 
Other reasons 

Sample size 



Alameda 



Experimentals who were ever deferred 

Reason for first deferral (%) 
Employed 15 to 29 hours per week 
Medically verified illness 
Severe family crisis 
No transportation 
No child care 

Emotional or mental problems 
Legal difficulties 
Alcoholism or drug addiction 
Other reasons 
Total 

Sample size 



46.2 



Butte 



Los 
Angeles 



Riverside San Diego 



31.5 



48.9 



48.0 



64.4 



Tulare 



53.3 



8.5 


11.5 


8.5 


13.3 


19.8 


17.3 


11.8 


3.5 


21.6 


13.7 


16.2 


9.8 


13.8 


4.5 


9.7 


8.9 


16.2 


10.2 


1.2 


4.0 


1.1 


1.2 


1.2 


6.2 


1.0 


0.5 


3.3 


0.0 


0.4 


0.9 


3.3 


1.0 


1.0 


4.4 


2.4 


1.8 


1.5 


1.5 


2.0 


2.4 


2.4 


1.3 


2.2 


1.0 


0.5 


1.2 


0.0 


1.8 


3.0 


4.0 


1.2 


2.9 


5.6 


4.0 


602 


200 


3013 


248 


247 


225 



*** 
*** 
*** 

(a) 
(a) 
(a) 
(a) 



18.3 


36.5 


17.4 


27.7 


30.8 


32.5 


25.5 


11.1 


44.1 


28.6 


25.2 


18.3 


29.9 


14.3 


19.8 


18.5 


25.2 


19.2 


2.5 


12.7 


2.2 


2.5 


1.9 


11.7 


2.2 


1.6 


6.8 


0.0 


0.6 


1.7 


7.2 


3.2 


2.0 


9.2 


3.8 


3.3 


3.2 


4.8 


4.1 


5.0 


3.8 


2.5 


4.7 


3.2 


1.1 


2.5 


0.0 


3.3 


6.5 


12.7 


2.5 


6.0 


8.8 


7.5 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


278 


63 


1474 


119 


159 


120 



(a) 
(a) 
(a) 
(a) 
(a) 



SOURCE: Calculations using data from the MDRC participant flow study. 

NOTES: Rounding may cause slight discrepancies in calculating sums and averages. 

A chi-square test was applied to differences across counties. Statistical significance levels are indicated as 
*** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) A test of statistical significance was not performed. 
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that "any education or training activity" was used by 28 percent (Butte) to 53 percent (Alameda) of 
all experimentals within the i 1-month follow-up period. 

Looking just at those experimental^ who entered any GAIN activity (i.e., the GAIN 
participants), it is evident that education and training characterized the program treatment most 
strongly in Alameda, Los Angeles, and Tulare, where 81 to 85 percent received such se^ices (mostly 
basic education). These activities were less common — although still used by a majority of 
participants - in Butte, Riverside, and San Diego, where 60 to 68 percent took part in them.^ In 
other words, across all six counties, no fewer than 60 percent of experimentals who took part in any 
GAIN activity participated in education and training, either in addition to or instead of job search 
activities}^ 

The overall participation experiences of AFDC-U and AFDC-FG experimentals were roughly 
similar. From 36 to 66 percent of the AFDC-U group participated in a GAIN activity. (See Appendix 
Table C.l.) These rates are close to those observed for the AFDC-FGs, although the county-by- 
county patterns were not always consistent for the two groups. 

Differences between the AFDC-U and AFDC-FG groups were more likely to be found in their 
use of particular GAIN activities. The AFDC-U group was somewhat more likely than the AFDC-FG 
group to enter basic education (particularly English as a Second Language) and considerably less likely 
to be in self-initiated activities. In part, the greater use of basic education by the AFDC-Us reflects 
their greater likelihood of being determined to need this service. Compared to the AFDC-FG sample, 
the AFDC-U group, which included a higher proportion of Asian refugees, more often had a limited 
knowledge of English, although other reasons may also have contributed to their higher participation 
in basic education. 

As will be discussed below, lengthening the follow-up period and including participation in non- 
GAIN (i.e., post-GAIN) activities as well as GAIN activities increased the ever participated rate by 
only small amount for most activities. The vocational training and post-secondary education category 
is the main exception to this pattern. 

IL Experimentals' Participation Rates and Length of Stay in Employment-Related Activities 
Within the Five Years After Orientation 

As mentioned at the outset of this chapter, GAIN'S ongoing participation mandate and 
experimental' wide use of potentially long-term education and training activities make it important to 
estimate participation over more than just a year. For this evaluation, participation rates and the 
duration of participation were estimated within the five years after orientation to capture continuing 
or repeated spells of participation. Five years was the period chosen for several reasons. Most 



^he county differences in these participation patterns partly reflect differences in the types of welfare 
recipients enrolled in GAIN (such as the proportion who were determined to need basic education), registrants' 
own preferences for types of services, and various implementation strategies and conditions. See Riccio and 
Friedlander, 1992, Chapters 2 and 3. 

^^hus» the other 15 to 40 percent of those starting a GAIN activity took part in job search and/or (in a 
small number of cases) PREP or OJT. 
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important is that this was the period used in estimating GAIN'S costs and benefits, as discussed in 
Chapters 3 and 7. Because the rate and duration of participation in employment-related activities affect 
average program costs and can also affect the earnings, welfare, and other impacts used in estimating 
economic benefits, it is essential to try to capture all participation that occurs within the time frame 
used for comparing benefits to costs. (Five years is also used by MDRC's past benefit-cost studies 
of welfare-to-work programs.) Another consideration was the varying amounts of follow-up data 
across counties. To make fair comparisons of county participation findings and costs, a common time 
frame must be used tor each county, and it must be sufficiently long to ensure that the participation 
estimates are not being seriously truncated in any of them.^^ Relying upon a five-year period for 
estimating participation in all six counties helps to minimize that risk. 

The longer-term participation estimates are intended to capture all participation by experimentals 
in employment-related activities, including those used in meeting the GAIN program's participation 
obligation as well as any that experimentals entered on their own, after leaving welfare and the GAIN 
program. Participation in "non-GAIN" activities is included because, theoretically, that type of 
participation could be affected by the GAIN program and, in turn, could influence an experimental's 
longer-term employment prospects and the program's future impacts and benefit-cost results. For 
example, GAIN'S basic education activities might help prepare some registrants to enter vocational 
training and post-secondary education, and they might be more inclined to do so, even after leaving 
welfare, than they would have had they never participated in GAIN. Or, conversely, GAIN may 
reduce some registrants' interest in or need for attending (non-GAIN) employment-related activities 
after leaving welfare. These kinds of effects, if there are any, could have important implications for 
the overall use of government resources as well as for experimental' future labor market and welfare 
experiences. Because they could influence GAIN'S benefit-cost results, it is essential to estimate them. 

A. Estimation Procedures 

For each major type of employment-related activity (such as job search, basic education, 
vocational training, and post-secondary education), the five-year length of participation estimate for 
experimentals has four key elements. As depicted in Figure 2.1 A, the participation could have 
occurred through the GAIN program (boxes 1 and 2), or it could have taken place after a person left 
welfare and hence was no longer associated with the GAIN program. For example, a former registrant 
might have enrolled herself in a community college training class a year after leaving welfare; this 
would be defined as "non-GAIN" participation, and would be reflected in boxes 3 and 4. Moreover, 
the participation ~ whether GAIN-related or non-GAIN - could have occurred within the first two 
to three years after orientation (i.e., the period covered by the registrant survey, as reflected in boxes 
1 and 3), or it could have taken place after the end of the survey period through the fifth year after 
orientation (i.e., the "post-survey" period, as reflected in boxes 2 and 4), or it could have occurred 
during both periods. For the purposes of this study, all such participation is relevant. Thus, the 
individual estimates per experimental for each of these four building blocks were sununed to get an 



"If, for example, many registrants were still participating in GAIN activities at the end of the two- to 
three-year survey follow-up period (as was found to be the case m Alameda), counting only the participation 
observed during the survey period could distort any comparisons of the duration of participation across the 
counties and result in costs being underestimated wherever participation estimates were artificially tiiincated. 
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estimate of the average duration of GAIN and non-GAIN participation within the full ^v«.-year period 
after orientation.^^ 

The remainder of this chapter focuses on findings for AFDC -FGs. However, some of the tables 
include results for AFDC-Us. 

B. Results for AFDC-FG Experimentals 

The top panel of Table 2.3 shows the estimated participation rate per experimental, by type of 
activity, for the two- to three-year survey follow-up period. (Because of the kinds of data available and 
the use of different samples, a five-year participation rate could not be estimated without the risk of 
overestimating the percentage of experimentals who participated in a given type of activity. However, 
this was not a problem when estimating the average number of months of participation over a five-year 
period.)^^ The table indicates that, across the six counties, about 29 percent of AFDC-FG 
experimentals participated in job search activities, and about the same proportion took part in 
ABE/GED activities. Only about 7 percent took part in ESL activities. It is noteworthy that the 
county-by-county results for these activities were not much higher than the 11-month follow-up results 
(based on casefile data alone) presented in Table 2.1. This means that most of the experimentals who 
started job search or ABE/GED and ESL classes did so through the CAIN program and within the first 
year after orientation. 

As expected, the participation rate for vocational training or post-secondary education - 
activities that, if not started as upfront self-initiated activities, come later in the GAIN model's service 
sequence - climbed more over time (i.e., from the 11-month follow-up figures shown in Table 2.1 
to those shown on the top panel of Table 2.3) than did the rate for job search and basic education 
activities. The rate ranged from 14 percent of experimentals in Los Angeles to 35 percent in San 



i^in making these estimates, the analysis followed several basic principles: It relied more heavUy on 
county casefile data to estimate the rate of the experimental group's participation in GAIN activities, but on 
the survey to estimate participation (by experimentals and controls) in non-GAIN activities. It also relied more 
heavily on the survey to estimate the duration of participation among those starting an activity (whether it was 
a GAIN or a non-GAIN activity). Special pomt-in-time participation data provided by the county welfare 
departments, which indicated a sample member's probabUity of participating in a specified GAIN activity on 
a specified day if she were receiving AFDC in the same month, were used in combination with administrative 
records data on the research sample's long-term use of AFDC to estimate post-survey participation in GAIN 
activities. Post-survey participation in non-GAIN activities was projected based on earlier patterns of 
participation and the assumption that all non-GAIN participation by both experimentals and controls declined 
steadily and ended by the end of the five-year period. 

i^There is also some risk of overestimating participation rates within the two- to three-year survey follow- 
up period. However, this is probably less of a risk for job search and basic education activities since, given 
GAIN'S activity sequencing rules, most first-time participation in those activities probably occurred within the 
first two to three years. Data from the registrant survey also support this conclusion by showing that hardly 
any respondents participated in GAIN and non-GAIN job search or GAIN and non-GAIN basic education. 
There was a slighUy higher chance of double-counting the rate of ever participating in vocational education 
or training activities, and so a minor adjustment was made in this category of activities to minimize this 
problem. All in all, while not exact, the estimated participation rates presented in Table 2.3 are unlikely to 
have been distorted by the risk of double-counting during the survey period. 
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TABLE 2.3 



LONGER-TERM PARTICIPATION PATTERNS IN EMPLOYMENT-RELATED ACTIVITIES 
(GAIN AND NON-GAIN) AMONG AFPC-FG AND AFDC-U EXPERIMENTALS 



A'^DC-FGs 



Sample and 
Outcome 



Alameda Butte (a) 



Los 
Angeles 



Riverside 



San 
Diego 



Tulare 



All 

Counties 



AFDC-Us (b) 
All 

Counties 



All experimentals 

Ever participated within two to 
three years after orientation in (%) 

Job search 

ABE/GED 

ESL 

Vocational training or 

post -secondary education 
Unpaid work experience 
OJT 



32.2 


n/a 


14.0 


38.0 


34.0 


24.2 


28.5 


24.9 


42.3 


n/a 


27.2 


20.7 


18.1 


36.9 


29.0 


18.8 


3.2 


n/a 


13.3 


6.7 


5.2 


6.7 


7.0 


16.7 


28.4 


n/a 


13.5 


26.8 


34.8 


28.6 


26.4 


14.2 


2.4 


n/a 


0.0 


0.0 


2.0 


0.7 


1.0 


0.8 


0.0 


n/a 


0.0 


0.8 


3.7 


0.3 


1.0 


0.2 



Experimentals who started 
specified activities within 
two to three years 
after orientation 

Average number of months 
participating within two to three 
years after orientation in 

Job search 

ABE/GED 

ESL 

Vocational training or 

post-secondary education 
Unpaid work experience 



1.6 


n/a 


1.7 


1.9 


2.2 


1.9 


1.9 


2.0 


7.9 


n/a 


9.9 


4.6 


5.0 


9.0 


7.3 


7.2 


12.5 


n/a 


8.1 


4.6 


5.0 


10.3 


8.1 


7.2 


10.8 


n/a 


9.5 


8.3 


8.6 


9.2 


9.3 


8.9 


3.3 


n/a 






1.5 


2.9 


2.6 


2.5 



All experimentals 

Average nu.nber of months 
participating within five years 
after orientation in 



Job search 


0.7 


0.7 


0.8 


1.0 


1.0 


0.6 


0.8 


0.8 


ABE/GED 


4.3 


1.7 


2.9 


1.3 


1.1 


3.7 


2.5 


1.7 


ESL 


0.4 


0.9 


1.4 


0.5 


0.4 


1.2 


0.8 


1.6 


Vocational training or 
















1.9 


post-secondary education 


4.5 


3.2 


1.9 


2.6 


3.8 


3.4 


3.2 


Unpaid work experience 


0.3 


0.3 


0.0 


0.1 


0.5 


0.0 


0.2 


0.2 



Sample size 

Program tracking data 602 200 3013 248 247 225 4535 1255 
Registrant survey data 335 n/a 223 674 337 356 1925 — 

SOURCE: Calculations using data from the MDRC participant flow study and the GAIN registrant survey. 

NOTES: Participation is defined as number of months with any participation. 

In the all-county averages, the results for each county are weighted equally. 
Where data are not available, "n/a" is used. 
Where data are not applicable, dashes are used. 

The results shown in the second panel of the table were calculated by dividing the average number of months 
participating in a given activity within two to three years after orientation among all registrants by the percentage of 
registrants who reported participating in that activity within the two to three years after orientation. 

(continued) 
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TABLE 2.3 (continued) 



Estimates for experimentals are based on data from several sources, including county casefile records (i.e., 
program tracking data) from the MDRC participant flow study, the GAIN registrant survey (which covered from 26 to 37 months 
after orientation, on average, depending on the county), point~in-time participation data from the survey and county records, 
and information on the length of time experimentals received AFDC during the follow-up period. 

Tests of statistical significance of the differences across counties were not performed. 

Rounding may cause slight discrepancies in calculating sums and averages. 

(a) Because the registrant survey was not conducted in Butte, some components of the duration of participation 
measures were imputed from survey data from the other counties, 

(b) The AFDC-U sample does not include any registrants from Alameda. Also, because the registrant survey 
included only a small number of AFDC-U registrants in each county, participation estimates for this group include imputations 
based on AFDC-FG survey and casefile data, as well as AFDC-U casefile data. 



Diego. However, unpaid work experience (PREP) and OJT positions were still used by only a 
small proportion of experimentals within the two- to three-year follow-up period. 

The middle panel of Table 2.3 shows the estimated average duration of participation per 
experimental who started a specified activity during that two- to three-year period. Duration is defined 
here as the average number of months in which a person participated for some hours }^ Among the 
six counties, participation in ABE/GED (which was almost entirely GAIN-related) was notably longer 
in Alameda, Los Angeles, and Tulare. Also noteworthy is the relatively long length of stay in 
vocational training or post-secondary education among experimentals who started such activities, 
ranging from 8 months per participant in Riverside to almost 11 months in Alameda. 

The bottom panel of Table 2.3 presents the estimated length of stay in activities averaged across 
all experimentals over the five years since orientation. (It is important to note that because these 
estimates are expressed per experimental, they include a zero value for people who never took part 
in a given activity. When estimated this way, the results can be compared, as they are below, to the 
average length of participation per control to determine GAIN'S impact on the use of employment- 
related services - an impact that will affect the experimental-control differences in costs and, in turn, 
the program's overall cost-effectiveness.) Of the six counties, Alameda had the longest average length 
of stay in ABE/GED activities (4.3 months per experimental) and in vocational training or post- 
secondary education (4.5 months per experimental). These patterns reflect that county's combination 
of comparatively high participation rates per experimental and longer lengths of stay among those 
starting the activities - patterns that were already evident in the first two to three years of follow-up, 
as indicated in the first two panels of Table 2.3. The duration of participation in ABE/GED activities 
was also relatively long in Tulare (3.7 months per experimental). Among the other counties, 
experimentals in Butte, Riverside, and San Diego had ti^e lowest average number of months 
participating in ABE/GED (1.1 to 1.7 months), and those in Los Angeles had the lowest average 
number of months participating in vocational training and post-secondary education. Overall, however, 
the substantial use of education and training services in all counties has important implications for 
program costs, as Chapter 3 will show.^^ 

It was mentioned previously that, in all counties, participation in job search and basic education 
activities occurred almost entirely while experimentals were enrolled in the GAIN program. However, 
as Figure 2.2 illustrates, the story was different for vocational training and post-secondary education. 
In the top graph, the full bar for each county depicts the average number of months in those activities. 
The shaded portion of the bar represents the average number of months of participation while 
experimentals were enrolled in GAIN, while the white portion reflects participation (often by different 
individuals) in non-GAIN (i.e., post-GAIN) activities of this type (e.g., after leaving AFDC). 



*^For an approximation of the change in usage over time, the vocational training participation rates in 
Table 2.3 can be compared to the sum of the rates of participation in self-initiated and post-assessment 
activities in Table 2.1. This sum is 21 percent in Alameda, 14 percent in Butte, 7 percent in Los Angeles, 
16 percent in Riverside, 24 percent in San Diego, and 17 percent in Tulare. 

^^This defmition was used in order to be consistent with the general approach that was considered most 
appropriate for measuring participation for the cost analysis presented in Chapter 3. 

^^he survey indicates that participants in basic education classes in Los Angeles were scheduled to attend 
those classes for more hours per week than were participants in most of the other survey counties, resulting 
in more total hours of participation and contributing to that county^s relatively high cost of basic education. 
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FIGURE 2.2 



DISTRIBUTION OF LENGTH OF STAY IN VOCATIONAL TRAINING 
OR POST-SECONDARY EDUCATION PER AFDC-FG EXPERIMENTAL, 
WITHIN FIVE YEARS AFTER GAIN ORIENTATION 



A. Estimated Average Number of Months Participating in GAIN vs. 
Non-GAIN Vocational Training or Post-Secondary Education, per Experimental 
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B. Estimated Average Number of Months Participating in Vocational Training 
or Post-Secondary Education Within the Two- to Three-Year Registrant Survey 
Follow-Up Period vs. the Post-Survey Follow-Up Period 
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SOURCE AND NOTES: See Tables 2.4 and 2.7. 



It is readily apparent from the size of the white portion of the bars that participation in non- 
GAIN vocational training and post-secondary education constituted a substantial share - from 16 
percent in Alameda to 45 percent in San Diego - of the total number of months of participation in 
those activities per experimental. GAIN was not the only route to training for experimentals. This 
is one reason why resources other than those conmianded directly or indirectly by the welfare 
department for GAIN registrants must be considered (as they are in Chapter 3) in estimating the 
average total cost of providing employment-related services to the experimental group. 

When the bars for each county are compared, Alameda stands out. In that county, GAIN- 
related participation in vocationally oriented activities (the shaded portion of the bar) accounted for the 
same or more months of participation than the combined GAIN and non-GAIN participation in the 
other counties. 

The bottom panel of Figiare 2.2 illustrates an important point about the timing of participation 
in vocational training and post -secondary education. In that graph, the shaded portion of each bar 
represents participation in vocational training or post-secondary education initiated during the two- to 
three-year survey follow-up period, while the white portion reflects participation in the post-survey 
period. In all counties, the shaded portion of the bar predominates, accounting for about 69 percent 
of the total months spent in such activities in Alameda to about 85 percent in Riverside. As will be 
discussed further in Chapter 3, this implies that most of the cost of these activities was incurred within 
about the first half of the five-year time horizon (as was true to an even greater degree for the other 
activities). 

IIL The Impact of GAIN on Participation in Employment-Related Activities Within the Five 
Years After Orientation 

A. Participation Patterns Among AFDC-FG Controls 

The registrant survey was used to estimate participation in employment-related activities among 
controls within two to three years after orientation; for the post-survey period, projections had to be 
made, based on the proportion of controls still participating in activities at the time of their survey 
interview. (Because the survey was not conducted in Butte, and the survey data on the small control 
group survey sample in Los Angeles were not considered reliable, alternative procedures that drew 
upon the survey findings in the other four counties had to be used for these two counties.)^^ Of 



^ '^The average length of stay in each activity among controls in Butte and Lx)S Angeles was approximated 
from patterns of control group behavior in the other four coimties, but adjusted to reflect, among other 
conditions, the very high representation in Los Angeles of registrants determined to need basic education, and 
the much lower representation of that population in Butte. Since the average length of stay per control group 
member varied so little across the other four counties (see the bottom panel of Table 2.4), the imputed 
estimates for Butte and Los Angeles can be viewed as quite reasonable approximations. It is also noteworthy 
that tlie resulting estimates for controls in Los Angeles are very close to the participation rates foimd for 
controls on the registrant survey itself. (See Appendix Table C.2.) Although neither of these approaches for 
estimating controls* participation patterns in Los Angeles are ideal, the fact that they each yield similar 
estimates reinforces the conclusion that the estimates presented in Table 2.4 for Los Angeles are indeed 
reasonable. 
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course, by definition, all participation by the control group was non-GAIN participation. The results 
are presented in Table 2,4. 

It is noteworthy that the control group's participation was substantial, but concentrated mostly 
in vocational training and post-secondary education. Indeed, for all counties combined, only about 4 
percent of AFDC-FG controls participated in job search activities within the two- to three-year survey 
follow-up period; 5 percent participated in ABE/GED courses; 3 percent participated in ESL courses; 
and even fewer took part in unpaid work experience and OJT assignments. However, about 23 percent 
of the controls took part in vocational training or post-secondary education. At the same time, 
except in Riverside, controls who started such activities tended to remain in them for a shorter period 
of time than did experimentals who started them. (Compare the middle panel of Table 2.4 to that of 
Table 2.3.) 

Experimental-Control Differences in Participation 

Table 2.5 directly compares the percentage of AFDC-FG experimentals and controls who 
participated in any employment-related activities (counting GAIN .and non-GAIN activities for 
experimentals) within the two- to three-year survey follow-up period. The difference in these rates 
represents the "impact" of GAIN, which tells how much experimental' participation changed 
compared to what it would have been in the ai>sence of GAIN.^^ As the table shows, GAIN'S impact 
on participation rates was largest for job search activities (25 percentage points for all counties 
combined) and ABE/GED (24 percentage points). The program had little overall impact (3.3 
percentage points) on the percentage ever participating in vocational training or post-secondary 
education. 

Table 2.6 presents GAIN'S impacts on the average number of months of participation in each 
activity, using data covering the full five-year period. (As previously explained, the averages per 
experimental and per control are lower than the averages per participant in each group because they 
include zero months of participation for those who never started a specified activity.) As the table 
shows, impacts are evident on this measure for all activities, but they are larger in some counties than 
others, depending on the activity. GAIN'S effects on the average length of stay in ABE/GED activities 



^*In part, this pattern may reflect a greater availability of vocational training and post-secondary education 
in the community, but controls may have also preferred these types of activities more than the others. 

^^ecause these impacts were based on measures constructed from several data sources, it was not possible 
to test their statistical significance. 

^^Appendix Table C.2 shows the estimated impact of GAIN on all activities, using the survey data alone, 
rather than following the preferred general principle described previously: relying more heavily on county 
casefile data to measure participation rates in GA];N activities among experimentals and survey data for 
estimating non-GAIN participation among expeiimentals and controls. An assessment of the quality of these 
survey data found that participation in GAIN job search and basic education activities had been underreported, 
which was one reason for the decision to rely more heavily on casefile data in estimating the rate of 
experimentals' participation in GAIN activities. It should also be noted that the survey sample does not 
completely match the participant flow sample for whom casefile data were collected for experimentals. 
Relying on the survey data alone for estimating GAIN'S impacts would have resulted in estimating notably 
smaller effects on job search and basic education but somewhat larger effects on the use of vocational trahung 
and post-secondary education. 
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TABLE 2.4 



LONGER-TERM PARTICIPATION PATTERNS IN EMPLOYMENT-RELATED ACTIVITIES 
AMONG AFDC-FG AND AFDC-U CONTROLS 



AFDC-FGs AFDC-Us (c) 

Sample and Los San All A!! 
Outcome Aiameda Butte (a) Angeles (b) Riverside Diego Tulare Counties Counties 

All controls 



Ever participated within two to 
three years after orientation in (%) 



Job search 


4.2 


n/a 


4.2 


1.4 


7.8 


1.7 


3.9 


2.7 


ABE/GED 


6.9 


n/a 


5.8 


. 4.8 


4.4 


5.3 


5.4 


3.6 


ESL 


0.4 


n/a 


2.8 


4.4 


2.8 


4.2 


2.9 


7.8 


Vocational training or 


















post -secondary education 


23.1 


n/a 


10.8 


28.6 


31.8 


21.2 


23.1 


12.4 


Unpaid work experience 


0.6 


n/a 


0.6 


0.6 


1.2 


0.8 


0.8 


0.8 


OJT . 


0.3 


n/a 


0.7 


0.8 


0.8 


1.1 


0.7 


0.8 



Controls who started 
specified activities within 
two to three years 
after orientation 

Average number of months 
participating within two to three 
years after orientation in 

Job search 

ABE/GED 

ESL 

Vocational training or 

post -secondary education 
Unpaid work experience 



1.7 


n/a 


2.9 


5.0 


3.6 


1.2 


2.9 


3.3 


4.8 


n/a 


5.2 


5.6 


4.8 


5.8 


5.2 


5.6 


5.0 


n/a 


4.6 


3.0 


2.1 


8.3 


4.6 


4.6 


8.0 


n/a 


6.9 


8.4 


7.7 


7.7 


7.7 


7.8 


1.7 


n/a 


3.3 


5.0 


1.7 


5.0 


3.3 


2.5 



All controls 



Average number of months 
participating within five years 
after orientation in 



Job search 


0.2 


0.2 


0.2 


0.1 


0.4 


0.0 


0.2 


0.1 


ABE/GED 


0.6 


0.4 


0.5 


0.4 


0.5 


0.4 


0.4 


0.3 


ESL 


0.1 


0.2 


0.2 


0.1 


0.2 


0.5 


0.2 


0.5 


Vocational training or 


















post -secondary education 


3.0 


3.4 


1.1 


3.9 


3.9 


2.7 


3.0 


1.5 


Unpaid work experience 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 



Sample size 

Registrant survey data 348 n/a 342 336 363 1389 

SOURCE: Calcul ations using data from the MDRC participant flow study and the GAIN registrant survey. 

NOTES: Participation is defined as number of months with any participation 

In the all-county averages, the results for each county are weighted equally. 
Where data are not available, "n/a" is used. 
Where data are not applicable, dashes are used. 

The results shown in the second panel of the table were calculated by dividing the average number of months 
participating in a given activity within two to three years after orientation among all registrants by the percentage of 
registrants who reported participating in that activity within the two to three years after orientation. • 
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TABLE 2.4 (continued) 

The folbw-up period for the survey ranged from 26 to 37 months, on average, across the five counties where the 
registrant survey was conducted. 

Estimates for controls are based on data from the registrant survey and projections for the post-survey period. 

"Vocational training or post-secondary education" includes a small proportion of individuals who attended 
high school. 

Tests of statistical significance of the differences across counties were not performed. 
Rounding may cause slight discrepancies in calculating sums and averages. 

(a) Because the registrant survey was not conducted in Butte, some components of the duration of participation 
measures were imputed from survey data from the other counties. 

(b) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, for all survey-based measures for the participation calculations, control group 
estimates in Los Angeles were imputed from data on controls' participation pattems in Alameda, Riverside. San Diego, and 
Tulare. 

(c) The AFDC-U sample does not include any registrants from Alameda. Also, because the registrant survey 
included only a small number of AFDC-U registrants in each county, participation estimates for this group include imputations 
based on AFDC-FG survey data. 




TABLE 2.5 



GAIN'S ESTIMATED IMPACTS ON THE PERCENTAGE OF REGISTRANTS WHO EVER PARTICIPATED 
IN EMPLOYMENT-RELATED ACTIVITIES WITHIN TWO TO THREE YEARS AFTER ORIENTATION 



AFDC-FGs ^ AFDC-Us (a) 



Outcome and 
Research Group 


Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


All 

Counties 


Ever participated in job search 
Experimentals (%) 
Controls (%) 
Difference 


32.2 
4.2 
28.0 


14.0 
4.2 
9.8 


38.0 
1.4 
36.6 


34.0 
7.8 
26.2 


24.2 
1.7 
22.5 


28.5 
3.9 
24.6 


24.9 
2.7 
22.2 


Ever participated in ABE/GED 
Experimentals (%) 
Controls (%) 
Difference 


42.3 
6.9 
35.4 


27.2 
5.8 
21.4 


4.8 
15.9 


lO.l 

4.4 
13.7 


5.3 
31.6 


5.4 
23.6 


lO.O 

3.6 
15.2 


Ever participated in ESL 
Experimentals (%) 
Controls (%) 
Difference 


3.2 
0.4 
2.8 


13.3 
10.5 


6.7 

A A 

4.4 
2.3 


5.2 
2.4 


6.7 
2.5 


7.0 
4.1 


16.7 

7 A 

8.9 


Ever participated in vocational 
training or post -secondary 
education 

Experimentals (%) 

Controls (%) 

Difference 


28.4 
23.1 
5.3 


13.5 
10.8 
2.7 


26.8 
28.6 
-1.8 


34.8 
31.8 
3.0 


28.6 
21.2 
7.4 


26.4 
23.1 
3.3 


14.2 
12.4 
1.8 


Ever participated in unpaid 
worK eApenence 

Experimentals (%) 

Controfe (%) 

Difference 


2.4 
0.6 
1.8 


0.0 
0.6 
-0.6 


0.0 
0.6 
-0.6 


2.0 
1.2 
0.8 


0.7 

0.8 
-0.1 


1.0 
0.8 
0.3 


0.8 
0.8 
0.0 


Ever participated in OJT 
Experimentals (%) 
Controls (%) 
Difference 


0.0 

0.3 
-0.3 


0.0 
0.7 
-0.7 


0.8 
0.8 
0.0 


3.7 
0.8 
2.9 


0.3 
1.1 
-0.8 


1.0 
0.7 
0.2 


0.2 
0.8 
-0.6 


Sample sizes 
Program tracking data 
Experimentals 
Controls 


602 
n/a 


3013 

n/a 


248 

n/a 


247 

n/a 


225 
n/a 


4335 

n/a 


1255 

n/a 


Registrant survey data 
Experimentals 
Controls 


335 
348 


223 


674 
342 


337 
336 


356 
363 


1925 
1389 





SOURCE: See Tables 2.3 and 2.4. 



NOTES: See Tables 2.3 and 2.4. 

Tests of statistical significance of the differences between research groups were not performed, 
(a) The AFDC-U sample does not include any registrants from Alameda. 
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TABLE 2.6 



GAIN'S ESTIMATED IMPACTS ON THE NUMBER OF MONTHS PARTICIPATING IN 
EMPLOYMENT-RELATED ACTIVITIES WITHIN FIVE YEARS AFTER ORIENTATION 



AFDC-FGs AFDC-Us (a) 



Outcome and 
Research Group 


Alameda 


Butte 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


Ail 

Counties 


Average number of months 
in job search activities 

Experlment':jls 

Controls 

Difference 


0.7 
0.2 
0.5 


0.7 
0.2 
0.5 


0.8 
0.2 
0.6 


1.0 
0.1 
0.9 


1.0 
0.4 
0.6 


0.6 
0.0 
0.6 


0.8 
0.2 
0.6 


0.8 
0.1 
0.7 


Average number of months 
in ABE/GED 

Experimentals 

Controls 

Difference 


4.3 
0.6 
3.7 


1.7 
0.4 
1.3 


2.9 
0.5 
2.4 


1.3 
0.4 
0.9 


1.1 
0.5 
0.6 


3.7 
0.4 
3.3 


2.5 
0.4 
2.1 


1.7 
0.3 
1.4 


Average number of months 
in ESL 

Experimentals 

Controls 

Difference 


0.4 
0.1 
0.3 


0.9 
0.2 
0.7 


1.4 
0.2 
1.2 


0.5 
0.1 
0.4 


0.4 
0.2 
0.2 


1.2 
0.5 
0.7 


0.8 
0.2 
0.6 


1.6 
0.5 

1.1 * 


Average number of months 
in vocational training or 
post-secondary education 

Experimentals 

Controls 

Difference 


4.5 
3.0 
1.5 


3.4 
-0.2 


1 .y 
1.1 
0.8 


3.9 
-1.3 


o.o 
3.9 
-0.1 


Q A 

2.7 
0.7 


<^ o 
o.^ 

3.0 

0.2 


1 Q 

1 .51 

1.5 
0.4 


Average number of months 
in unpaid work experience 

Experimentals 

Controls 

Difference 


00 O 09 

odd 


0.3 
0.0 
0.3 


0.0 
0.0 
0.0 


0.1 
0.0 
0.1 


0.5 
0.0 
0.5 


0.0 
0.0 
0.0 


0.2 
0.0 
0.2 


0.2 
0.0 
0.2 


Sample sizes 
Program tracking data 
Experimentals 
Controls 


602 
n/a 


200 

n/a 


3013 

n/a 


248 
n/a 


247 
n/a 


225 

n/a 


4535 

n/a 


1255 
n/a 


Registrant survey data 
Experimentals 
Controls 


335 
348 


n/a 
n/a 


223 


674 
342 


337 
336 


356 
363 


1925 
1389 





SOURCE: See Tables 2.3 and 2.4. 



NOTES: See Tables 2.3 and 2.4. 

Tests of statistical significance of the difi'erences between research groups were not performed, 
(a) The AFDC-U sample does not include any registrants from Alameda. 
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and in vocational training and post-secondary education are of particular interest, for these activities, 
unlike job search, were usually scheduled to last for more than just a few weeks and, unlike unpaid 
work experience, were used by a substantial proportion of experimentals. GAIN increased the 
duration of participation in ABE/GED activities by 2. 1 months per experimental for the six counties 
combined. GAIN also had an effect on the average length of stay in vocational training and post- 
secondary education, but the direction of this effect varied across the counties, from a reduction of 1.3 
months, on average, in Riverside to an increase of 1.5 months in Alameda. 

Another way to view the program's impacts on service receipt is to examine those effects 
separately for two subgroups that, under GAIN'S rules, were subject to different sequences of 
activities: those who were determined to need basic education and those who were determined not to 
need it. Of particular interest with regard to the latter group was their use of vocational training and 
post-secondary education. Table 2.7 shows that Alameda substantially increased the rate of 
participation in those activities by experimentals in the not-in-need subgroup - by more than 16 
percentage points during the two- to three-year survey follow-up period. Moreover, as Appendix 
Table C.3 indicates, it increased (over the five-year time period) their length of stay in such activities 
by 3.5 months per experimental, above and beyond the average length of participation per control. 
No other county produced such a large increase. In contrast. Riverside appears to have reduced the 
use of vocational training and post-secondary education by 2.0 months, on average, by the 
experimentals in this subgroup, as shown in Table C.3.'^^ At the same time, both Riverside and 
Alameda - and other counties as well — produced large impacts on the proportion of experimentals 
not needing basic education who ever panicipated in job search activities. 

Table 2.8 and Appendix Table C.4 present similar participation data for those registrants who 
were determined to need basic education. It shows that all of the counties substantially increased the 
participation rates and the aveiage length of participation in ABE/GED classes per experimental in this 
subgroup (and, to a smaller extent, in ESL classes). Furthermore, all counties increased participation 
in job search activities, with Riverside producing the largest impact on the overall rate of participation 
in this component. 

To summarize: GAIN'S impacts on participation varied across the basic education subgroups. 
For those determined not to need basic education, the program in some counties increased the use of 
both job search and vocational education and training activities (especially in Alameda) or of job search 
alone; and in some cases (especially in Riverside), it reduced the use of education and training, on 
average. For those determined to need basic education, GAIN increased participation in job search 
and basic education. Overall, the program produced little net effect on the use of unpaid work 
experience and OJT for either of these subgroups. These patterns are important, because they will 
help to explain much of the county variation in costs and benefit-cost findings discussed in Chapters 
3 and 7. 

C. Impacts on Educational Attainment 

In some counties, GAIN also appears to have affected educational attainment. As Table 2,9 



^^This reduction could have occuiTed in a number of ways. For example, it is possible that some 
experimentals who might have participated in vocational training in the absence of GAIN may have been 
directed into job search activities by the GAIN program and found a job without first participating in training 
activities. If this occurred, it would imply that GAIN led to a substitution of job search and quicker 
employment for the participation in vocational training that would have otherwise occurred. 



TABLE 2.7 



FOR THOSE DETERMINED NOT TO NEED BASIC EDUCATION: 
GAIN'S ESTIMATED IMPACTS ON THE PERCENTAGE OF AFDC-FG REGISTRANTS WHO EVER PARTICIPATED 
IN EMPLOYMENT-RELATED ACTIVITIES WITHIN TWO TO THREE YEARS AFTER ORIENTATION 



Outcome and 
Research Group 


Alameda 


Los 

Angeles (a) 


Riverside 


San Diego 


Tulare 


Ail Counties 


cver panicipaieQ in jod searcn 
Experimentals (%) 
Controls (%) 
Difference 


55.9 
3.6 
52.3 


25.8 
2.9 
22.9 


50.1 
2.3 
47.8 


41 .9 
7.9 
34.0 


46.4 

3.0 
43.4 


44.0 
3.9 
40.1 


Ever participated in ABE/GED 
Experimentals (%) 
uonirois \7o) 
Difference 


8.2 
o.o 
4.7 


3.8 
1.8 


0.0 

n 7 

-0.7 


0.0 

0 7 

-0.7 


3.3 
2.5 
0.8 


3.1 
1.9 
l!2 


Ever participated in ESL 
Experimentals (%) 
Controls (%) 
Difference 


0.5 
0.0 

n R 
u.o 


0.3 
0.1 


0.0 
0.0 

n n 


0.0 
0.4 

\j .*+ 


0.0 
0.0 
0.0 


0.2 
0.1 
0.1 


Ever participated in vocational 
training or post-secondary 
education 

Experimentals (%) 

Controls (%) 

Difference 


48.3 
31.9 
16.4 


27.6 
23.0 
4.6 


40.9 
43.3 
-2.4 


48.3 
43.5 
4.8 


48.8 
36.7 
12.1 


42.8 
35.7 
7.1 


Ever participated in unpaid 
work experience 

bxperimeniais \7o) 

Controls (%) 

Difference 


1 Q 

0.0 
3.9 


n n 
1.2 
-1.2 


n n 
0.7 
-0.7 


3.6 
2.7 
0.9 


1.8 
1.5 
0.3 


1 .9 
l!2 
0.6 


Ever participated in OJT 
Experimentals (%) 
Controls (%) 
Difference 


0.0 
0.4 
-0.4 


0.0 
0.8 

-0.8 


0.0 
1.0 
-1.0 


8.4 
0.7 
7.7 


0.7 
1.1 
-0.4 


1.8 
0.8 
1.0 


• Sample sizes 

Program tracking data 
Experimentals 
Controls 


209 

n/a 


583 

n/a 


81 
n/a 


110 
n/a 


79 
n/a 


1062 
n/a 


Registrant survey data 
Experimentals 
Controls 


109 
106 




282 
148 


146 
147 


140 

137 


677 
538 



SOURCE: See Tables 2.3 and 2.4. 

NOTES: See Tables 2.3 and 2.4. 

Tests of statistical significance of the differences between research groups were not performed. 

(a) Because the registrant survey sample of experimentals detennined not to need basic education in Los Angeles 
was too small to produce reliable results, some components of the participation measures were imputed from survey data from 
the other counties. 
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TABLE 2.8 



FOR THOSE DETERMINED TO NEED 3ASIC EDUCATION: 
GAIN'S ESTIMATED IMPACTS ON THE PERCENTAGE OF AFDC-FG REGISTFOVNTS WHO EVER PARTICIPATED 
IN EMPLOYMENT-RELATED ACTIVITIES WITHIN TVO TO THREE YEARS AFTER ORIENTATION 



Outcome and 

Research Sample Alameda Los Angeles Riverside San Diego Tulare All Counttes 



Ever participated in job search 
Experlmentals (%) 
Controls (%) 
Difference 


19.6 
3.8 
15.8 


11.2 
3.8 
7.4 


32.0 
0.7 
31.3 


27.4 
7.5 
19.9 


12.4 
0.9 
11.5 


20.5 
3.3 
17.2 


Ever participated in ABE/GED 
Experimental (%) 
Controls (%) 
Difference 


60.5 
8.7 
51.8 


32.8 
7.1 
25.7 


30.8 
6.4 
24.4 


32.6 
7.3 
25.3 


55.1 
6.9 
48.2 


42.4 
7.3 
35.1 


Ever participated in ESL 
Experimentals (%) 
Controls (%) 
Difference 


4.6 
0.5 
4.1 


16.4 
3.7 
12.7 


9.8 
8.1 
1.7 


9.5 
4.5 
5.0 


10.5 
6.4 
4.1 


10.2 
4.6 
5.5 


Ever participated in vocational 
training or post-secondary 
education 

Experimentals (%) 

Controls (%) 

Difference 


18.5 
18.3 
0.2 


10.7 
7.6 
3.1 


18.6 
19.8 
-1.2 


24.3 
22.5 
1.8 


16.8 
12.8 
4.0 


17.8 
16.2 
1.6 


Ever participated in unpaid 
work experience 

Experimentals (%) 

Controls (%) 

Difference 


1.5 
0.8 
0.7 


0.0 
0.4 
-0.4 


0.0 
0.5 
-0.5 


0.7 
0.0 
0.7 


0.2 
0.4 
-0.2 


0.5 
0.4 
0.1 


Ever participated OJT 
Experimentals (%) 
Controls (%) 
Difference 


0.0 
0.2 
-0.2 


0.0 
0.7 
-0.7 


1.2 
0.5 
0.7 


0.0 
0.8 
-0.8 


0.0 
1.1 
-1.1 


0.2 
0.7 
-0.4 


Sample sizes 
Program tracking data 
Experimentals 
Controls 


393 
n/a 


2430 
n/a 


167 

n/a 


137 
n/a 


146 

n/a 


3273 

n/a 


Registrant survey data 
Experimentals 
Controls 


226 
242 


189 
n/a 


392 
194 


191 
189 


216 
226 


1214 
851 



SOURCE: See Tables 2.3 and 2.4. 



NOTES: See Tables 2.3 and 2.4. 

Tests of statistical significance of the differences between research groups were not performed. 
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shows for those determined not to need basic education, Alameda increased the receipt of a trade 
certificate by almost 6 percentage points (although this result was not statistically significant) and the 
receipt of a Bachelor's degree by 3 percentage points (an effect that was statistically significant). 
These patterns at least suggest that Alameda's impacts on this group's use of education and training 
resulted, for some, in education credentials that they would not have otherwise obtained and that may 
have had some effect on their employment and welfare experiences. It is also noteworthy that San 
Diego produced an increase of 5 percentage points (statistically significant) on the receipt of an 
Associate's degree for experimentals in the not-in-need subgroup. For those determined to need basic 
education, Alameda and Tulare produced a statistically significant increase in the attainment of a GED, 
by almost 8 percentage points and 19 percentage points, respectively. However, according to a 
previous MDRC report, San Diego was the only county to produce a statistically significant increase 
in basic skills, as measured by the TALS literacy test, among registrants determined to need basic 
education.^^ 



IV. CounfaL Differences in Implementation Strategies 

The GAIN "treatment," through which counties aim to move welfare recipients into jobs and 
off welfare, consists of a variety of elements. Participation in the program's activities is fundamental. 
However, participation patterns are by no means the whole story, for what registrants experience in 
GAIN is heavily influenced by how the program is implemented and what kinds of direct interactions 
registrants have with staff. These issues are discussed in this and the following section of this chapter. 
Table 2.10 summarizes county differences on a variety of implementation dimensions. Chapter 8 
will examine whether some of the implementation strategies help to explain the county differences in 
three-year impact results. 

In many welfare-to-work programs, it is through the case managers that the mission of the 
program is communicated to registrants and the efforts of the welfare department to influence their 
behavior are expressed. It is thus reasonable to expect, as many administrators do, that the way the 
role of case manager is defined and put into practice may greatly influence the program's effectiveness 
in moving registrants into jobs and off welfare. 

MDRC's previous reports on GAIN gave special attention to several alternative ways of 
providing case management in welfare-to-work programs. These dimensions of program implementa- 
tion embody competing theories of how welfare-to-work programs can most effectively help welfare 
recipients progress toward self-sufficiency. They also have important implications for how a 
program's resources will be allocated. Consequently, it is important for administrators to know 
whether some of these approaches have a more favorable influence on impacts than others. 

A. The Degree of Emphasis on Quick Job Entry Vs> More Education and Training 

An important decision that GAIN administrators (and those of other JOBS programs) must make 
is how much to emphasize the goal of moving registrants into the labor market quickly (even if it 



^^Martinsou and Friedlander, 1994. None of the other counties produced statistically significant positive 
effects on this outcome measure. 

^^See Riccio and Friedlander, 1992, Chapter 3, for a fall description of these strategies and other 
implementation approaches and conditions. See Martinson and Friedlander, 1994, for details on the 
implementation of the basic education component. 




TABLE 2.9 



GAIN'S IMPACTS ON RECEIPT OF AN EDUCATION CREDENTIAL WITHIN TWO TO THREE YEARS 
AFTER ORIENTATION FOR AFDC-FG REGISTRANTS. BY COUNTY 



Outcome and 
Research Group 


Alameda 


Los 

Angeles (a) 


Riverside 


San 
Diego 


Tulare 


All 

Counties 


Full sample 














Received GED or 
high school diploma 
during follow-up period 

Experlmentals (%) 

Controls (%) 

Difference 


7.2 

0.9 

6.2 *** 


2.2 


4.0 
3.5 
0.5 


4.8 
2.0 

2.8 ** 


13.0 

1.1 

1 1 .9 *** 


7.2 
1.9 

5.4 (b) 


Received trade certificate 
during foltow-up period 

Experlmentals (%) 

Controls (%) 

Difference 


7.9 
6.1 
1.8 


3.1 


9.8 
9.2 
0.6 


10.2 
1^.4 
-2.1 


9.0 
7.6 
1.3 


9.2 
8.8 

0.4 (b) 


Received Associate's degree 
during foltow-up period 

Experimentals (%) 

Controls (%) 

Difference 


-0.1 
0.9 
-1.0 * 


0.9 


2.1 
. 1.8 
0.3 


3.0 
0.8 
2.1 * 


1.7 
0.9 
0.7 


1.7 
1.1 

0.6 (b) 


Received Bachelor's degree 
during foltow-up period 

Experimentals (%) 

Controls (%) 

Difference 


0.8 
-0.0 
0.8 


0.9 


1.1 
0.6 
0.5 


0.9 
0.3 
0.5 


1.1 

0.3 
0.9 


1.0 
0.3 

0.7 (b) 


Experimentals with credential by 
end of follow- up period (c) (%) 

GED or high school 
diploma 

Trade certificate 

Associate's degree 

Bachelor's degree 


61.8 
28.1 
3.3 
1.8 


33.6 
9.4 
4.5 
2.2 


55.6 
28.2 
4.9 
1.6 


59.6 
35.9 
6.5 
3.6 


61.5 
25.3 
5.1 
1.4 


59.6 
29.4 
5.0 
2.1 


Sample size 
Experimentals 
Controls 


335 
348 


223 


674 

342 


337 
336 


356 
363 


1925 
1389 


Those determined not 
to need basic education 














Received trade certificate 
during foltow-up period 

Experimentals (%) 

Controls (%) 

uirrerence 


13.1 
7.2 
o.y 





14.1 
12.4 

A -7 
1 ./ 


15.3 
16.7 

— i A 

— 1 .*f 


10.9 
10.7 


13.3 
11.8 

1 .D \p) 


Received Associate's degree 
during foltow-up period 

Experimentals (%) 

Controls (%) 

Difference 


-0.1 
1.1 
-1.2 




4.6 
4.1 
0.4 


5.9 
0.9 

5.1 ** 


4.0 
2.4 

1.6 


3.6 
2.1 

1.5 (b) 


Received Bachelor's degree 
during foltow-up period 

Experimentals (%) 

Controls (%) 

Difference 


3.0 
-0.2 
3.2 * 




2.2 
1.3 
0.9 


1.9 
0.9 
1.1 


3.0 
0.6 
2.4 


2.5 
0.7 

1.9 (b) 
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(continued) 



TABLE 2.9 (continued) 



Outcome and 
Research Group 


Alameda 


Los 

Angeles (a) 


Riverside 


San Diego 


Tulare 


All Counties 


Experimentals with credential by 
ena OTTOiiow^up penoo (C/ [to) 

Trade certificate 

Associate's degree 

Bachelor's degree 


46.8 
6.4 
5.5 


— 


39.4 
11.0 
3.6 


50.7 
13.7 
6.9 


39.3 
12.1 
3.6 


44.1 
10.8 
33.3 


Sample size 
Experimentals 
Controls 


109 
106 




282 
148 


146 
147 


140 
137 


677 
538 


Those determined 

to need basic education 














Received GED or 
high school diploma 
during follow-up period 

Experimentals (%) 

Controls (%) 

Difference 


9.0 
1.5 
7.5 


2.7 

*** 


6.0 
4.0 
2.0 


6.1 
3.2 
2.9 


20.8 
1.8 
18.9 


10.5 
2.6 

*** 7.8 (b) 


Received trade certificate 
during follow-up period 

Experimentals (%) 

Controls (%) 

Difference 


5.3 
5.9 
-0.6 


3.2 


6.7 
7.0 
-0.3 


6.3 
8.9 
-2.6 


8.0 
5.6 
2.4 


6.6 

6.9 
-0.3 (b) 


Received Associate's degree 
during foltow-up period 

Experimentals (%) 

Controls (%) 

Difference 


-0.1 
0.8 
-0.9 


0.5 


0.3 
0.0 
0.3 


0.9 
0.7 
0.1 


0.0 
0.0 
0.0 


0.3 
0.4 
-0.1 (b) 


Expei mentals with credential by 
end of follow-up period (c) (%) 

diploma 
Trade certificate 
Associate's degree 


46.0 
19.0 
1.8 


24.9 
7.9 
3.2 


26.8 
20.2 
0.5 


32.5 
24.6 
1.1 


38.4 
16.2 
0.5 


35.9 
20.0 
15.9 


Sample size 
Experimentals 
Controls 


226 
242 


169 


392 
194 


191 
189 


216 
226 


1214 
851 



SOURCE: MDRC calculations using data from tlie GAIN registrant survey. 
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NOTES: A two-tailed t-test was applied to the differences between the experimental and control groups in each county. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

Tests of statistical significance of the differences across counties were not performed. 

Where data are not applicable, dashes are used. 

Estimates of experimental -control differences are regression-adjusted using ordinary least squares, controlling 
for pre-random assignment background characteristics of sample members. Regression-adjustment sometimes results 
in negative experimental or control group means when the full sample unadjusted mean is close to zero. 

Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

In the all-county averages, the results of each county (excluding Los Angeles) are weighted equally. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, no estimates for controls and no impacts are presented for Los Angeles. Also, 
because the registrant survey sample of experimentals determined to need basic education in Los Angeles was too small 
to produce reliable results, no estimates are presented for this subgroup for Los Angeles. 

(b) Tests of statistical significance of the experimental-control differences for all counties combined were not 

performed. 

(c) This category includes credentials received both before and during the follow-up period. 
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means taking relatively low-paying jobs) versus encouraging them to get more education or training 
so as to prepare themselves for better-paying jobs in the future. Although the GAIN model's 
prescribed sequences of services (see Chapter 1) limit the ways in which counties can choose to 
prepare welfare recipients for employment, the counties can substantially influence the direction taken 
by the program through the policies and practices staff follow on a day-to-day basis. Supporting the 
quick job entry approach is a view that almost any job is a positive first step, and that advancement 
will come thiough acquiring a work history and learning skills on the job. Support for the second 
approach comes from the view that low-paying jobs will not get many recipients off welfare or keep 
them from returning to the rolls. Many proponents of the latter view hold that education and training 
are needed to raise recipients' skills so that recipients can become permanently employed in jobs that 
offer wages and benefits exceeding what they could receive on welfare. Prior research offers little 
guidance forjudging which approach is likely to yield bigger impacts on employment and welfare over 
the longer term.^"^ 

It must be stressed that a county's emphasis on quick job entry may or may not be reflected in 
the proportion of registrants participating in job search. For example, two counties with similar job 
search participation rates might present very different "messages" to registrants about employment. 
As an illustration, staff in some counties tend to discourage registrants who enter job search from 
seeking very low-paying or "dead-end" jobs, urging them instead to take full advantage of the 
program's subsequent option for more education and training. They advise registrants to view upfront 
job search as an "informational experience," which would provide job-seeking skills and would be 
valuable after further education and training. In other counties, the primary objective of job search 
is to encourage immediate employment, with lower priority attached to the starting wage rate,^^ 
These different messages about employment may also be communicated at other junctures in the 
program, including the initial orientation and appraisal sessions, and during ongoing contacts with 
registrants who are in education activities, are temporarily deferred from participation, or are waiting 
to be assigned to a new activity. 

The six counties examined for this report varied in how they wanted to prepare registrants for 
employment. To compare counties, a scale was constructed using data from a staff survey .^^ The 
stronger a county staffs emphasis on quick employment, the higher the county's score on this scale. 
The summary data for each county are presented in Figure 2.3A, where a higher score is represented 
by a longer bar. 

Riverside clearly stands apart from the other counties on this dimension: Its staff placed much 



^'^his question is being studied directiy in the National JOBS Evaluation, using a random assignment 
research design. In three evaluation sites, welfare recipients have been randomly assigned to a "labor force 
attachment" stream, which aims to move clients into jobs as quickly as possible; a "human capital 
development" stream, which emphasizes longer-term education and training; or a non-JOBS control group 
The employment, earnings, and welfare outcomes for each group over a follow-up period lasting several years 
will be compared to determine the relative effectiveness of each strategy. Riverside County is one of the three 
sites in which this test is being conducted. Short-term fmdings from that comparison are scheduled to be 
available by 1996, 

^These alternative approaches to job search were also observed in MDRC's 1989 report on the early 
implementation of GAIN in a different set of counties. See Riccio et al,, 1989, 

^^For a description of the methodology that was used to create scales based on the staff survey, see Riccio 
and Friedlander, 1992. 
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FIGURE 2.3 



COUI^!TY DIFFERENCES IN SELECTED IMPLEMENTATION 
PRACTICES AND CONDITIONS 
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FIGURE 2.3 (continued) 
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Recipients as Wanting to Work 



Alameda 
Butte 
Los Angeles 
Riverside 
San Diego 
Tulare 




1185.7 



m40.4 




68.7 



0 20 40 60 80 100 
Staff Who Answered "High" on Scale (%) 



F. Degree to Which Staff Believed GAIN 
Could Help Registrants 



Alameda 
Butte 
Los Angeles 
Riverside 
San Diego 
Tulare 



!!L^^S45.0 



Tn7K9 



y7^28,3 



Si!SlI3IZ]44.5 



Z^77.1 



0 20 40 60 80 100 
Staff Who Answered "High" on Scale (%) 



SOURCE: MDRC Staff Activities and Attitudes Survey. 



ERLC 



-53- 



more emphasis on moving registrants into the labor market quickly than did the staff in any other 
county, Alameda and Butte had the lowest scores (i.e., they placed greater priority on being more 
selective and preparing for a "better" job through more education and training), L9.S Angeles, San 
Diego, and Tulare rank in between, but closer to Alameda and Butte than to Rivers ide.^"^ 

The emphasis in Riverside on quick employment was created, in part, by assigning case 
managers job placement standards. Further, supervisory units and district offices were assigned job 
placement goals as well, culminating in a county-wide goal. (None of the other evaluation counties 
had such a policy.) Administrators created these standards to send a clear message to staff that job 
placements were a high priority for the agency. How well staff met their job placement standards 
(which applied to registrants in education and training activities as well as to those in job search) was 
an important determinant of their overall job performance ratings. (However, there was no evidence 
that Riverside staff were "creaming" their caseload - in other words, giving more attention to 
registrants who seemed most job-ready - in order to reach their standards. This is a conmion risk 
associated with placement standards. )^^ Also in Riverside, each local office had its own job 
developer, who established contacts with the employers in the community and encouraged them to call 
the GAIN office when they had positions open. Other counties gave much less priority to direct job 
development.^^ 



^^Riverside's distinction on this dimension can be seen more clearly when the responses to two of the 
items in the scale are examined. Staff in all counties were asked, "Based on the practices in your agency 
today, what would you say is the most important goal of your agency: to help clients get jobs as quickly as 
possible or to raise the education or skill levels of clients so that they can get jobs in the future?" In 
Riverside, 95 percent of the case managers rated quick job entry as a much stronger program focus than 
education and training. In the other counties, fewer than 20 percent gave a similar response. Another item 
asked hypothetically about a welfare recipient who was offered a low-paying job that would make her slightly 
better off financially. Would the respondent advise her to "take the job and leave welfare" or "stay on welfare 
and wait for a better opportunity"? In Riverside, 69 percent of respondents said that they would "very 
strongly" urge her to take the job; only 23 percent in Alameda, and no more than 40 percent in the other 
counties, gave this answer. 

^^In general, staff reported that the standards were not terribly difficult to meet, given the number of 
registrants with whom they worked, but felt pressure to achieve, and even exceed, them. Tendencies toward 
creaming were kept m check by management's expectation that staff would work with, and be able to account 
for, their entire GAIN caseload. For example, a staff member would not be evaluated positively if he or she 
had achieved high placement rates but at the same time had failed to assign to a GAIN activity other 
registrants who were expected to participate, or had excused registrants inappropriately from the participation 
requirement through excessive deferrals. Indeed, implementing GAIN'S participation obligation for welfare 
recipients — an objective to which Riverside's administrators were also committed — required staff to work 
with all registrants on their caseloads, not just the most motivaited or easiest to place. 

^^verside's job development efforts raise the question of whether these efforts had the unintended 
consequence of indirectly reducing opportunities for the control group. In other words, did the controls have 
more difficulty obtaining jobs precisely because employers gave first preference to GAIN participants or 
because the program got its participants to apply for jobs so soon after openings were first advertised? If 
controls had less access to jobs as a direct consequence of Riverside's efforts on behalf of the experimental 
group, it would mean that the estimates of the program's impact on experimentals' employment and earnings 
are misleading. There is no evidence at hand indicating that the control group's employment options were 
limited by Riverside's job development efforts for experimentals. Furthermore, such an effect seems 
implausible given the small size of Riverside's entire research sample (8,033, of whom 1,799 were controls) 
relative to the magnitude of Riverside's overall economy, which, in mid- 1990, had almost 20,000 employers 

(continued,.,) 
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Riverside's quick employment emphasis is also reflected in a finding from the registrant survey. 
Respondents were asked, "How much did the GAIN staff push you to get a job quickly, even before 
you felt ready?" In Riverside, 43 percent of those who responded answered "high*' (i.e., 7 to 10) on 
a 10-point scale, which was higher than in all of the other counties, as shown in Table 2.11 (although 
special caution is urged in comparing counties on this and the next two items in the table because many 
of those interviewed did not answer these questions). 

The differences across counties on this measure are particularly noteworthy for the subsample 
of registrants determined not to need basic education (not shown in Table 2.11). For that group, 
Alameda and Tulare both stand out as having had the lowest proportion of respondents (about 15 
percent of those who answered the question) answering "high" on the measure (i.e., that they felt 
"pushed" to get a job quickly), while in Riverside, 46 percent of this group answered "high." 

In Alameda especially, this finding is consistent with the strong staff commitment to education 
and training as a path to getting jobs that offer a better chance to get off or stay off welfare, 
Alameda's approach to operating GAIN's job search component provides one illustration of that 
commitment. Alameda went further than any of the other counties in using job club as an 
"informational experience." Participants on a designated job club track (which accounted for the 
majority of those assigned to upfront job search) were not necessarily expected to look for a job that 
they could enter inmiediately. They were to find out from employers what kinds of qualifications were 
required and what wages and benefits they could expect from different types of work. This 
information was intended primarily to help registrants pick an education and training program when 
they got to the GAIN assessment. A number of GAIN staff described this component as essentially 
"career exploration." 

B. The Issue of Personalized Attention 

In addition to deciding how much to emphasize quick job entry versus more education and skills 
training, administrators of welfare-to-work programs must consider how much personalized attention 
registrants will receive. On this dimension, too, the six counties varied. Moreover, these variations 
appear to be correlated with other program characteristics, such as a county's registrant-to-case- 
manager ratio (personalized attention was typically higher where case managers had fewer registrants 
assigned to them)^^ and the organizational climate within the GAIN office (staff tended to have more 
"positive" views of the program, their jobs, and welfare recipients where personalized attention was 
higher). Figure 2.3 shows how the counties compare on these dimensions. 



^^(... continued) 

within its boundaries and almost 431 ,000 employed residents. This is not to say, however, that, in any of the 
six research counties, an increase in employment among experimentals causes no reduction in employment 
opportunities for some other residents in a county. The extent of such "displacement," if it occurs, is 
extremely difficult to measure. Nonetheless, it is an issue relevant to interpreting a program's benefit-cost 
ratio, as noted in Chapter 8. 

■'^his relationship is clearer when comparing the counties using data on registrant-to-case-manager ratios 
from the second wave of the staff survey, as shown in Table 2.10. It is also useful to note that, in Butte, the 
decision to limit caseload sizes in the face of a waiting list for the program clearly reflected a view that it is 
better to serve fewer welfare recipients with more personalized attention than to provide less attention in order 
to serve a larger number of recipients. 

^^It may be that more personalized- attention is the kind of service that GAIN staff themselves prefer to 
provide, and that when they are providing this type of service, they view their work, their clients, and the 
program overall in more optimistic terms. 
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TABLE 2.11 



PERCEPTIONS OF GAIN AMONG AFDC~FG EXPERIMENTALS 
TV/O TO THREE YEARS AFTER ORIENTATION 



Los All 
Measure Alameda Angeles Riverside San Diego Tuiare Counties 

Responses to questions 

about GAIN'S employment focus 

"How much did the GAIN staff push you to get 
a job quickly, even before you felt ready?" 

Percent who responded to the question 75.8 73.8 85.7 79.1 85.2 79.9 

Percent who answered "high" (7-10 on a 

0-10 scale), rf responded 27.2 16.8 42.6 33.5 18.8 27.8 

Responses to questions about 
relationships with GAIN'S staff 

"How much did your most recent GAIN case 
manager know about you and your family?" 

Percent who responded to the question 89.2 78.6 92.0 91.3 91.4 88.5 

Percent who answered "high" (7-10 on a 

0-10 scale), if responded 53.8 53.5 43.0 47.1 56.1 50.7 

"How much did you like your relationship with 
your most recent GAIN case manager or 
counselor?"* 

Percent who responded to the question 84.8 79.3 89.1 89.1 88.1 86.1 
Percent who answered "high" (7-10 on a 

0-10 $?cale), if responded 72.0 64.3 63.9 69.3 73.0 68.5 

Responses to questions about 
GAIN'S participation mandate (a) 

"Were you made aware that your cash aid from 
AFDC could be reduced or stopped if you didn't 
participate in GAIN, unless you had a good 
excuse?" (%) 

Yes 93.8 91.5 93.7 88.6 93.7 92.3 

No 6.2 8.5 6.3 11.4 - 6.3 7.7 

"If GAIN sent you to an education or employment 
program and you did not go, how likely do you 
think it is that your cash aid from AFDC would 
actually be reduced?" (%) 

Veryjikely or likely 92.6 90.0 94.1 89.7 91.8 91.6 

Unlikely or very unlikely 4.0 8.6 4.5 6.9 5.6 5.9 

Not sure 3.5 1.4 1.4 3.4 2.6 2.5 

Responses to questions about GAIN'S value (b) 

"Back when you first started GAIN, how much did 

you think GAIN would improve your chances of 

getting or keeping a job in the long run?" 

Average score on a 0-10 scale 5.9 6.6 5.9 5.9 6.4 6.1 

Percent who answered "high" (7-10) 48.1 60.2 51.5 48.8 56.8 53.1 
on the scale 

"What's your opinion now? How much do you 

think GAIN has actually improved your long-run 

chances of getting or keeping a job?" 

Average score on a 0-10 scale 5.1 4.7 4.3 5.2 5.7 5.0 

Percentwho answered "high" (7-10) 43.9 38.5 36.5 44.6 50.2 42.7 
on the scale 
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TABLE 2,1 1 (continued) 



Los All 
Measure Alameda Angeles Riverside San Diego Tulare Counties 

"If a friend on welfare could volunteer to be in the 
GAIN program, how much would you encourage 
him or her to get into it?" 

Average score on a 0-10 scale 7.4 6.8 6.9 7.7 7.8 7.3 

Percentwho answered "high" (7-10) 67.5 61.4 63.2 72.6 76.4 68.2 
on the scale 



Sample size 223 145 460 230 244 1302 

SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: The folbw-up period for the survey ranged from 26 to 37 months, on average, across the five counties where the 
survey was conducted. Butte County was not included in the survey. 

In the all -county averages, the results for each county are weighted equally. 

Rounding may cause slight discrepancies in calculating averages. 

(a) From 95.5 percent to 98.8 percent of survey respondents (experimental and controls combined) responded to 
the specific items in this panel across the five counties. Nonresponders are not included in determining the percentage who 
responded with a particular answer. 

(b) From 78.6 percent to 93.9 percent of survey respondents (experimentals and controls combined) responded to 
the specific items in this panel across the five counties. Nonresponders are not included in determining the percentage 
who answered "high." 

Tests of statistical significance of the differences across counties were not performed. 
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The nature of the case managers' role in GAIN permits staff variation across counties in the 
execution of their responsibilities. For example, case managers may differ in how much they attempt 
to learn about registrants' personal histories and circumstances; how much they discuss the implications 
of choosing basic education over job search, or different kinds of job search, or different kinds of child 
care; how much they try to accommodate registrants' individual needs, situations, and preferences in 
making service assignments; znd how much they stress persuasion, cajoling, counseling, and problem- 
solving when faced with registrants who are reluctant to participate or fail to do so consistently. 
Counties that more strongly emphasize personalized attention tend to view this as a way to increase 
registrants' interest in GAIN and their desire to participate in its activities, to lessen greatly the need 
to rely on financial sanctions to enforce the participation mandate,^^ and, ultimately, to produce 
larger impacts on employment, earnings, and welfare savings. 

According to a scale used to measure each county's relative emphasis on personalized attention, 
Butte and Tulare staff reported the strongest emphasis. Alameda and San Diego ranked lower, but 
were fairly close to Butte and Tulare. Los Angeles and Riverside had the lowest relative scores (see 
Figure 2.3B). It must be stressed that, as with all of the rankings based on the staff survey, a "lower** 
score indicates a lower ranking only relative to the other counties in this study and should not be 
interpreted as a "low" ranking in an absolute sense. Indeed, in most of the counties, most staff gave 
responses suggesting a moderate to high degree of personalized attention. It is certainly possible that, 
on the whole, the level of attention provided in most counties far exceeded what occurs in some other 
welfare-to-work programs. Nonetheless, the six counties did differ substantially among themselves 
in the degree to which these concerns were the focus of case managers' interactions with 
registrants.^^ 

Registrants were asked on the registrant survey how much their case managers "knew about you 
and your family," a question that seems related to the concept of personalized attention. The 
proportion giving a "high" response to this question ranged from 43 percent of those who answered 
it in Riverside to 56 percent in Tulare. (See Table 2.11.) Most surprising, given Los Angeles' lower 
ranking on the staff survey measure of personalized attention, is that over half of that county's 
respondents also answered "high." I[owever, registrants' views differed by basic education subgroup 
(not shown in Table 2. 11). For the subgroup determined not to need basic education, the proportion 
giving a "high" response (among those wh-) answered the question) ranged from only 29 percent and 
36 percent in Los Angeles and Riverside to about half or more (up to 58 percent) in the other counties. 
In fact, the "high" responders in Los Angeles and Riverside were to be found mostly in the group 
determined to need basic education, perhaps because they tended to remain enrolled in GAIN for a 
longer period of time, allowing staff more opportunity to get to know them and their families well.^"^ 



^^There is no necessary relationship between the level of personalized attention and the ultimate 
sanctioning rate in a county. A county could resort to sanctions or continue to avoid them after early attempts 
at persuasion fail to achieve cooperation. 

•'•'Staff responses to a question about the appraisal process illustrate the differences among counties: "In 
this type of interview, how much effort does die staff make to learn about the client's goals and motivations 
to work in-depthV More than 75 percent of the staff in Butte and Tulare answered "a great deal" compai-ed 
to 36 to 52 percent of staff in the other counties. A second item asked about the assessment process: "In 
your opinion, how well is GAIN tailoring the education, training, and work experience services that clients 
receive to their particular needs, circumstances, and goals?" Approximately 60 percent of the staff in Tulare 
answered "very well" compared to about 22 percent of the staff in Los Angeles and Riverside. (These county 
differences are consistent with information obtained through on-site observation and interviews.) 

•^"^ Among those determined to need basic education, roughly half of respondents in all counties (from 44 
to 58 percent of those responding to the question) answered "high." 
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It is also noteworthy that when respondents were asked how much they Uked their GAIN case 
manager, a majority of those responding to the question answered "high" (7 to 10 on a 10-point scale) 
in all five survey counties. The range was from almost two-thirds in Los Angeles and Riverside to 
almost three-quarters in Alameda and Tulare (see Table 2.11). 

C. Responding to Noncompliance Through Formal Enforcement 

Administrators of mandatory welfare-to-work programs generally have some discretion in 
operationalizing the formal enforcement process — and, in particular, financial sanctions - as a 
method of securing registrants' compliance with the program's participation obligation. In the GAIN 
program, there is an official multi-step process for imposing penalties on registrants who fail to attend 
their assigned activity regularly. It begins with the registrant's being sent a Notice of Participation 
Problems (a "GAIN -22" form) outlining the sanctions that may be applied if the problems continue. 
If compliance is not forthcoming, a "conciliation" process is initiated, providing another opportunity 
to resolve the problem and avoid a sanction. The financial sanctions are the final step and involve a 
reduction in the size of the welfare grant. 

Some administrators believe that high compliance can be achieved without a heavy reliance on 
sanctions, and that great efforts should be made to avoid imposing them except as a last resort. Others 
believe that sanctions are an essential tool for obtaining compliance and that, as long as the 
enforcement process is administered fairly, case managers should not take extraordinary steps to avoid 
using them. 

Table 2. 12 shows how counties compare in terms of the proportion of AFDC-FG and AFDC-U 
experimentals for whom staff invoked GAIN'S formal enforcement procedures during the 11 -month 
follow-up period for the tracking data. The first row in the top panel of the table indicates the 
proportion of AFDC-FG registrants placed in conciliation, sanctioned, or slated for sanctioning (i.e., 
deregistered from GAIN with a request to the Income Maintenance department to sanction). 

Overall, Los Angeles and Riverside stand out as having had the highest rates of invoking 
GAIN'S formal enforcement mechanism among the AFDC-FGs, using these procedures for about 34 
percent of those registrants.^^ However, the actual sanctioning rate was lower: 5.4 and 6.0 percent 
of AFDC-FG experimentals, respectively. Alameda, Butte, and Tulare were at the lower end, 
resorting to formal enforcement procedures for about 2 to 12 percent of AFDC-FGs. San Diego ranked 
between these two groups of counties. Across the counties, actual sanctioning rates appear to have 
increased over time, according to self-reported data from the two- to three-year registrant survey. 



^^See Chapter 1 . The Notice of Participation Problems instmcts the registrant to call or visit the case 
manager for a "cause determination" meeting and warns that a failure to respond may affect the registrant's 
welfare benefits. If no "good cause" is found to account for the participation problem, the next step is 
conciliation, an attempt by the case manager (and sometimes involving the supervisor) to get the registrant 
to agree to begin participating as required. The final step is financial sanctioning, whereby the registrants' 
welfare grants are reduced by eliminating their share of the grant until they cooperate. Prior to implementation 
of the JOBS regulations (when about 55 percent of the sample in this study was randomly assigned), a sanction 
for AFDC-FG registrants meant a reduction in their welfare grant for three or six months; for AFDC-U 
registrants, it meant the temination of their welfare grant for three or six months. The duration of the 
sanction in both cases depended on whether the registrant was in noncompliance for the first or second time, 

^^Some registrants who were slated for sanctioning left AFDC before the sanction took effect. See 
Riverside County Department of Public Social Services, 1992. 
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Although these data may be less accurate than information collected directly from die counties' 
cTmes almost 14 percent of respondents said they had their AFDC grants reduced because of 
participation problems. 

Most experimentals (89 to 94 percent) reported on the registrant '^''^y ^^^y^Z^t 
aware that theiV AFDC grant could be reduced if they did not comply with ^ f ma 
mandate. (See Table 2.11.) Most (90 to 94 percent) also believed that it was "very likely or likely 
that their grants would actually be reduced if they were sent to a program activity and did not go 
T?ese f^nLgs suggest that all the counties successfully commumcated to registrants that the • 
partLipation fequirfment was real and would be enforced, although the counties vaned m the exten 
o?2 reliance on the formal penalty process and some may have been "tougher" or more lement 
than others. 

D. Ex perimentals' Overall Assessment of GAIN 

The fourth panel of Table 2.11 includes one question from the registrant survey that asked 
respondents how much they had expected GAIN to "improve mir\ chances ^^^^^^ or^^^^^ ^ 
lob in the long run," and a second question asking how much they believed GAIN has acmally 
mp oved [2] ^ng-nin chances of getting or keeping a job." Interestingly, initial expectations were 
S wl 48 percent (Alameda) to 60 percent (Los Angeles) of survey respondents answering high 
( e 7 to lO^n the 10-point scale). Most striking is the considerably smaller proportion m Los 
A^des and Riverside (39 and 37 percent, respectively) giving a "high" response to the sec^d 
milt on concerning GAIN'S actual effect. The reason for the decline in expectations in these two 
is u™ ndlspecially surprising in Riverside, which has had die hi^st ^^^^V^^ 
on employment and earnings of all die counties. Perhaps it was related to a lower dian anticipated u e 
o?SS/vltional training and post-secondary education, activities diat were expected to budd 
skiuX average lengd". of stay in diese activities per experimental was somewhat lower m Riverside 
Z i^dieX survefcounties except Los Angeles) nr to die types of jobs diose who were becoming 
employed were getting (see Chapter 5), or to a combination of diese factors. 

Nonedieless, in all of die survey counties, a majority of survey respondents did W^^ntly^^^^^ 
some value in die GAIN program. As Table 2.11 shows, across die counties, 61 to 76 Percent of 
s^ey r^pornts answered "high" when asked, "If a friend on welfare could volunteer to be m die 
GAIN program, how much would you encourage him or her to get into it.' 

V. Evpprimentals' a pH rnntrols' Att itudes Tow ard P artici pation Mandates, Work 
Hi^q iiirements. and the CountY Welfare Department 

The registrant survey was also used to gauge respondents' opinions about die principle of 
requiring participation in education and training activities as a condition for ^^^'i^^^f 
grant as die GAIN program requires. The responses to die first two items listed in Table 2.13 show 
S^t froL about half to diree-quarters of survey respondents (depending on die county) expressed 
SpfnTor a pS^^^ nianLe, believing it to be "fair" and "a good idea." T^ese views were 
E atut equally by controls and experimentals. Also ^j^^^^^^^^ 
minority (about one-quarter) of respondents in each group agreed widi die statement. Making weltare 
modiers work if diey don't want to is bad for dieir children." 
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TABLE 2.13 



GAIN s TWO^TO THREE- YEAR IMPACTS ON AFDC-FG REGISTRANTS' ATTITUDES TOWARD 
PARTICIPATION REQUIREMENTS, WORK REQUIREMENTS, AND THE 
COUNTY WELFARE DEPARTMENT 



Outcome and 
Research Group 



Alameda 



Los 

Anqeies (a) 



Riverside 



San 
Diego 



Attitudes toward participation 
requirements 

Percent who said that it was 'fair" or 'Very 
fair" for welfare agencies to require recipi- 
ents to go to an education or employment 
program, and to reduce their AFDC grants 
if they did not comply with that rule 

Experimentals 

Controls 

Difference 

Percent who thought that a participation 
mandate was a "good idea" or a "very 
good idea" 

Experimentals 

Controls 

Difference 

Sample size 
Experimentals 
Controls 



Attitudes concerning the work 
requirements and the county welfare 
department 

Strongly agreed (answered 7-10 on a 
0-10 scale) that: 

"Making weltare mothers work if they 
don't want to is bad for their children" 

Experimentals (%) 

Controls (%) 

Difference 

Average score (on a 0-10 scale) for 
"Making welfare mothers work if they 
don't want to is bad for their children" 

Experimentals 

Controls 

Difference 

Strongly agreed (answered 7-10 on a 
0-10 scale) that: 
"In my county it's easy to just stay 
on AFDC and not try to get off' 

Experimentals (%) 

Controls (%) 

Difference 

Average score (on a 0-1 0 scale) for 
"In my county it's easy to just stay on 
AFDC and not try to get off' 

Experimentals 

Controls 

Difference 



50.4 
48.8 
1.6 



55.4 
55.2 
0.2 



223 
231 



25.4 
22.4 
3.0 



3.9 
3.7 
0.2 



29.4 
25.5 
3.9 



4.1 
3.9 
0.3 



64.1 



64.8 



145 



24.3 



3.7 



22.6 



3.4 



61.8 
68.6 
-6.8 



64.5 
73.0 
-8.5 ** 



460 
228 



25.1 
26.5 
-1.4 



3.7 
3.9 
-0.2 



29.7 
33.8 
-4.1 



4.1 
4.4 
-0.3 



66.2 
64.6 
1.7 



71.4 
71.0 
0.4 



230 
231 



27.0 
25.6 
1.4 



3.8 
4.0 
-0.2 



Tulare All Co unties 



31.7 
38.1 
-6.4 



4.2 
4.9 
-0.7 ** 



74.4 
69.8 
4.6 



77.6 
72.7 
4.8 



244 

250 



20.7 
26.2 
-5.5 



3.4 
3.9 
-0.5 



37.3 
45.6 
-8.3 ** 



5.0 
5.4 
-0.4 



63.2 
63.0 
0.3 (b) 



67.2 
68.0 
-0.7 



1157 
940 



(b) 



24.6 
25.2 
-0.6 (b) 



3.7 
3.9 
-0.2 (b) 



32.0 
35.8 
-3.7 



(b) 



4.3 
4.6 
-0.3 (b) 
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(continued) 



TABLE 2,13 (continued) 



Outcome and 
Research Group 


Alameda 


Los 

Angeles (a) 


Riverside 


San 
Diego 


Tulare 


All Counties 


Strongly agreed (answered 7-10 on a 
0- to scale) that: 

"It's easy to make extra money while on 
AFDC without the welfare department 
knowing about IT 

Experimental (%) 

Controls (%) 

Difference 


14.8 
16.0 
-1.2 


12.6 


17.8 
18.7 
-0.9 


20.6 
19.6 
0.9 


22.4 
20.0 
2.4 


18.9 
18.6 
0.3 (b) 


Average score (on a 0-10 scale) for 
"It's easy to make extra money while on 
AFDC without the welfare department 
knowing about if 

Experimental 

Controls 

Difference 


2.3 
2.4 
-0.1 


2.2 


2.6 
2.8 
-0.1 


2.8 

2.9 
-0.1 


3.0 
2.8 
0.2 


2.7 
2.7 
-0.0 (b) 


Percent who viewed "positively" or "very 
positively the welfare system and the 
things it did to help poor people 
in their county 

Experimentals (%) 

Controls (%) 

Difference 


45.1 
47.0 
-1.9 


62.6 


53.8 
55.8 
-2.0 


65.1 
65.3 
-0.2 


56.1 
57.1 
-1.0 


55.0 
56.3 
-1.3 (b) 


Sample size 
Experimental 
Controls 


335 
348 


223 


674 
342 


337 
336 


356 
363 


1925 
1389 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 



NOTES: A two -tailed t-test was applied to the differences between the experimental and control groups in each county. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent 

Estimates of the experimental -control differences are regression-adjusted using ordinary least squares, controlling 
for pre-random assignment background characteristics of sample members. Regression-adjustment sometimes results in 
negative experimental or control adjusted means when the full sample unadjusted mean is close to zero. 

Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

In the all-county averages, the results for each county (excluding Los Angeles) are equally weighted. 

The foltow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

From 87.3 percent to 100.0 percent of survey respondents (experimentals and controls combined) responded to 
the specific items in this table across the four counties. Nonresponders were not included in calculating the results presented. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, no estimates for controls and no impacts are presented in this table for Los Angeles. 

(b) Tests of statistical significance of the experimental -control difference for all counties combined were not 

performed. 
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CHAPTERS 

THE COST OF GAIN AND NON-GAIN ACTiyiTIES 



The cost analysis is designed to answer questions concerning the government's financial 
investment in employment-related services (e.g., job search, education, training, and support services) 
for welfare recipients who entered the GAIN program in the six study counties. For example, what 
costs did the county welfare departments incur for GAIN? What costs were incurred by non-welfare 
agencies that, as part of the GAIN program, provided employment-related services to GAIN 
registrants? What types of activities were most and least expensive, and why? What was the cost of 
child care and other support services? Answers to these and related questions are important for 
understanding the average amount of government resources that were spent on each person in GAIN 
for the employment-related services they received within the chosen time frame of five years after 
orientation (and which were described in Chapter 2). These cost estimates may also be of value to 
welfare administrators and planners who may need to assess the fiscal implications of future proposals 
to modify the structure and operation of the GAIN program, or who may need to estimate the potential 
cost of other state and national welfare reform proposals. 

The most important goal ot the cost analysis, though, is to estimate the average net cost of 
services per experimental. (The analysis focuses on costs per experimental rather than per participant 
because GAIN incurs costs for working with all who enter it, whether or not they actually attend a 
program activity.) Net costs represent the difference between the average cost per experimental and 
the average cost per control of all employment-related services that were used during a specified period 
of time following a person's entry into the study. As discussed in Chapter 2, a sizable number of 
controls participated on their own initiative in community-provided employment-related activities, 
usually vocational training or post-secondary education. 

Net cost numbers are key to determining whether GAIN has been a cost-effective investment 
from the perspective of government budgets. In the benefit-cost analysis to be presented in Chapter 
7, each county's net costs will be compared to the value of any budgetary savings it achieved (e.g., 
in the form of reduced payments for AFDC and other transfer programs) and increase in tax revenues 
associated with increased earnings among experimental. (Chapter 7 will also consider the benefits 
and costs from the perspectives of the welfare sample and society as a whole. It will be important to 
consider the benefit-cost results from a variety of perspectives in order to assess the overall merits of 
GAIN.) 

In estimating the net cost of GAIN, however, it is not sufficient to compare the average cost 
of GAIN-related activities per experimental to the average cost per control for non-GAIN activities. 
Such a comparison will not provide a complete picture of the government's net investment because, 
as Chapter 2 showed, some experimentals participated in non-GAIN education and training activities 
after leaving GAIN. Even though they were not part of the GAIN program, these activities 
represented an additional investment of government resources that could have affected the experimental 
group's future earnings and welfare receipt. Thus, to estimate the true magnitude of the government's 
net cost per experimental, the total cost per control must be compared to the total cost per experimental 
of GAIN an^ non-GAIN employment and training activities. 
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This chapter will show that, for all six counties combined, the estimated average cost of all 
GAIN and non-GAIN services per AFDC-FG experimental within the five years after orientaiiun (in 
1993 dollars) was $4,895, but that the net cost, at $3,422, was about 70 percent of that amount. The 
chapter will also show substantial variation across counties. 

The chapter begins by presenting an overview of the major components of the cost analysis and 
the general procedures used to compute each of the cost estimates. It then discusses the cost findings 
in detail for AFDC-FG registrants, focusing on GAIN expenditures by each county's welfare 
department (using federal, state, and local funds) and by non-welfare agencies (e.g., schools and other 
service providers); the cost of non-GAIN services used by experimental rfter leaving the GAIN 
program; the cost of employment-related activities used by controls; and the net cost of employment- 
related activities per experimental. Finally, in a more summary fashion, the chapter compares the cost 
results for AFDC-FGs who were determined not to need and to need basic education, and for the full 
sample of AFDC-U registrants. 

L Major Components of the Cost Analysis 

The top panel of Figure 3.1 depicts the major elements of the cost analysis. It illustrates that 
GAIN-related expendituies by the county welfare department (box 1) plus GAIN-related 
expenditures by non-welfare agencies (box 2) together make up the total cost of GAIN per 
experimental (box 3). These two main categories of GAIN costs cover the following types of 
expenditures: 

By the county welfare department: 

GAIN operating costs . This category covers expenditures for the core set of 
responsibilities that fall to welfare department GAIN staff (or subcontractors to 
the welfare agency) for the day-to-day operation of the program. They include 
expenses for: conducting orientations, appraisals, and assessments; operating job 
clubs and providing job search assistance;^ covering "excess costs" incurred by 
adult schools and community colleges for extra attendance monitoring and 
reporting that they provide for GAIN students; paying performance incentives 
(in some counties) to education providers; and providing ongoing case 
management for registrants, including monitoring those who are deferred and 
administering the formal penalty process for those who do not comply with 
GAIN'S participation mandate.*^ Box la in the bottom panel of Figure 3.1 
shows the main categories of activities over which all county welfare department 
operating costs for GAIN are allocated. 



^As noted in Chapter 2 (see Table 2. 10), the welfare departments in two counties (Butte and Tulare) used 
GAIN staff to operate the job clubs and to provide job search assistance directly, while the other counues 
(Alameda, Los Angeles, Riverside, and San Diego) subcontracted these functions wholly or in part to the 
Employment Development Department (EDD), but still paid for them with welfare department GAIN funds. 

^It is important to note that this analysis does not include the costs incurred for Income Maintenance staff 
to register welfare recipients for GAIN, refer them to orientation, or impose grant reductions for those 
referred for sanctioning. 
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FIGURE 3.1 

SIMPLIFIED DEPICTION OF THE MAJOR ELEMENTS OF 
GROSS AND NET COSTS 



GAIN-related expenditures 
by the county welfare 
department for case 
management, support 
services, job search 
assistance, monitoring, 
and other services 



® 



GAIN-reiated 
expenditures by 
non-welfare agencies 
(i.e., for GAIN 
education and 
training) 



& 



Total Cost 
of GAIN 
per Experimental 



Total 

Gross Cost 
per Experimental 



Non-GAIN cost per 
experimental: 
Expenditures by non- 
welfare agencies for 
non-GAiN activities 
used by experlmentais 
(i.e., for post-GAIN 
job search, education, 
and training) 



Cost per control: 
Expenditures by non- 
welfare agencies for 
non-GAIN job search, 
education, and 
training used by 
controls 



Total 
Gross Cost 
per Control 



Difference = 
Net cost per experimental 
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County Welfare 
Department 
GAIN Cost 



County Welfare Department 
GAIN Operating Costs 



Expenditures for GAIN case 
management, and other services 
related to: 

• Orientation, appraisal, and assessment 

• Job search activities 

• ABE/GED 

• ESL 

• Vocational training or post- 
secondary education 

• Unpaid work experience 
•OJT 



+ 
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County Welfare Department 
GAIN Support Service Costs 



• In-program child care 

• Transportation 

• Ancillary services 



GADJ support service costs . These include the cost of child care payments, 
transportation reimbursements, and ancillary services (e.g., for books, tools, or 
uniforms) intended to make it feasible for many registrants to participate in 
GAIN activities. (See box lb of Figure 3.1.) 

By non-welfare agencies: 

Operating costs . These are the operating costs incurred by the local adult 
schools, community colleges, and other non-welfare agencies that provided the 
actual classroom instruction. The money for these expenditures-includes funds 
from the California Department of Education (e.g., for adult schools and 
Regional Occupational Centers and Programs, or ROC/Ps), the California 
Community Colleges, JTPA, and other public sources, all of which the providers 
received directly rather than through the welfare department. 

Chapter 2 pointed out that GAIN was not the only source of employment-related activities used 
by experimentals. Some experimentals participated in non-GAIN activities on their own after leaving 
welfare and the GAIN program.^ When this occurred, the participation was most likely to have been 
in vocational training or post-secondary education. Because these experiences may have contributed 
to increases in earnings and other benefits and reductions in welfare payments and other transfer 
payments, it is important to consider the cost of such activities. As Figure 3.1 shows, adding this 
category - expenditures by non-welfare agencies for non-GAIN (i.e., post-GAIN) employment- 
related activities (box 4) - to the total cost of GAIN per experimental (box 3) yielded the total gross 
cost per experimental (box 5). 

Figure 3.1 also shows that non-welfare agency expenditures for non-GAIN employment- 
related services (box 6) make up the entire total gross cost per control (box 7), which represents the 
average level of expenditures that would have occurred for GAIN experimentals in the absence of the 
program. These costs simply reflect the control group's use of community-provided (non-GAIN) 
services that they entered without any assistance from GAIN or county welfare department staff. (No 
data were available in this study on the cost of non-GAIN support services that controls may have 
received, or that experimentals may have received after leaving GAIN.) Subtracting the average total 
gross cost per control (box 7) from the average total gross cost per experimental (box 5) yields the net 
cost per experimental, the figure to be compared to the net financial benefit produced by GAIN. The 
term gross cost is used to distinguish all GAIN and non-GAIN (i.e., post-GAIN) expenditures per 
experimental and all non-GAIN expenditures per control from the experimental-control difference, or 
net cost. 



^Some of the agencies providing these services, and agencies used by controls, may have been proprietary 
schools that charge students tuition. However, in many cases, low-income stodents who attend these types 
of institutions receive Pell Grants or other government stodent aid. For the purposes of this analysis, all non- 
welfare agency non-GAIN expendimres are assumed to reflect costs incurred by the government, though 
students may have invested their own or their family's money to attend these activities. To the extent that this 
occurred, the estimated average total gross cost per experimental and average total gross cost per control 
presented in this chapter would overstate the true costs incurred by the government. Some information from 
the registrant survey suggests that fewer than 10 percent of all experimentals and conttols may have spent their 
own or their family's resources on education and training; among those who did, a majority appear to have 
spent less than $300. 
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Costs are estimated over a five-year period for all counties, as are the benefits (including 
GAIN'S impacts) presented in Chapter 7's benefit-cost analysis. This is the same time ftame used in 
earlier MDRC benefit-cost studies of welfare-to-work programs. Although, as Chapter 2 indicated, 
most of the participation in employment-related activities occurred within the first two to three years 
after GAIN orientation, there was some participation four and even five years later. This is to be 
expected in a program such as GAIN, in which individuals are required to continue participating as 
long as they are receiving welfare and meet the program's criteria mandating participation. Although 
the six counties in this study faced funding constraints that limited their ability to implement such a 
requirement fully for all mandatory GAIN registrants (and two of them - Los Angeles and Alameda 
- had to limit the program to long-term welfare recipients, as discussed in Chapter 1), they gave a 
priority to members of the experimental group v/ho remained on welfare or who returned to the rolls 
after having exited eariier in the follow-up period. Thus, it was important for the cost analysis to 
attempt to capture all participation in GAIN activities (as well as in non-GAIN activities) over a period 
of several years. As it turned out, most costs for experimentals and for controls were incurred 
within the first two to three years after random assignment, when most of the participation in 
employment-related activities took place, but some additional costs were incurred after that point. 

Finally, to be consistent with the calculation of program benefits, all estimates are expressed 
in 1993 dollars. 



II. The Cost of GAIN to the County Welfare Department (Figure 3.1. Box 1) 

This section examines the GAIN expenditures of the county welfare departments, both their 
operating expenditures and support service payments. 

A. Operating Costs (Figure 3.U Boxes 1 and la) 

The costs incurred by each county welfare department for the day-to-day operation of GAIN 
have been allocated across seven major activities or components of the program, which are listed in 
box la of Figure 3.1. These are: 

• Orientation, appraisal, and assessment. Expenditures included personnel 
costs, overhead expenditures, and direct costs incurred for determining 
registrants' suitability for participation in various GAIN activities. These 
functions included conducting orientation sessions, appraising new registrants, 



'^A five-year time horizon also allows the variation in costs across the six counties to be assessed more 
accurately than would a shorter time frame. Although a period this long requires some projection of costs, 
it helps to insure that the county differences in costs are not being distorted simply by differences in the 
amount of follow-up data available for key items used in measuring costs. These include casefile and 
registrant survey data on use and duration of participation in activities, and data on support service payments. 
Moreover, a five-year horizon helps to avoid underestimating costs in counties where the length of stay in 
activities was longer. For, example, about one-quarter of Alameda's sample of registrants who were 
determined not to need basic education reported that they were still participating in GAIN-related vocational 
training or post-secondary education at the time of the survey interview (which, on average, occurred 30 
months after GAIN orientation for Alameda's survey respondents). See Chapter 2 for a discussion of rate and 
duration of participation in employment-related activities in the six counties. 
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deferring some registrants from the participation requirement, referring others 
to their initial GAIN activity, referring (later in the program sequence) some 
registrants to outside vendors for in-depth testing and assessment (for which the 
welfare department pays directly), completing the Employment Development 
Plans (EDPs) at the conclusion of the assessment process, and completing all 
paperwork associated with orientations, appraisals, and assessments. 

• Job search activities. Expenditures included the staff salary costs (along with 
the corresponding overhead) for conducting job club sessions and supervising 
individual job search activities (or paying an outside agency - EDD - to 
provide these services, as previously discussed). They also covered a number 
of case management functions for registrants assigned lo job search activities, 
such as arranging for and authorizing payments for support services for 
participants, completing paperwork (e.g., scheduling and attendance logs) 
associated with job search assignments, contacting no-shows and dropouts, 
discussing program requirements with individuals who were not complying with 
them, and administering GAIN'S formal penalty process (up to the referral of 
cases to the Income Maintenance department for sanctioning) for those who were 
noncompliant while assigned to job search activities. The job search category 
also included some staff time spent providing job placement and development 
assistance to job search participants. 

• ABE/GED and ESL classes, vocational training or post-secondary education, 
unpaid work experience (i.e., PREP), and OJT assignments. The county 
welfare departments' expenditures for these activities covered similar types of 
costs to those discussed above. They largely represented the cost of staff time 
(and corresponding overhead) spent developing program "slots," discussing 
component requirements, monitoring and counseling participants, contacting no- 
shows and dropouts, administering the formal penalty process, providing direct 
job placement assistance (where emphasized), and arranging and autliorizing 
child care and other support service payments. (Actual child care and other 
support service payments were not included in these costs, but are discussed 
separately below, because, unlike operating costs, they did not concern the 
allocation of welfare department personnel and administrative resources.) Also 
included were payments tliat some counties made directly to some education 
providers (such as adult schools providing ABE/GED and ESL instruction) to 
supply the county with detailed attendance information on GAIN students that 
they were not otherwise funded to collect and report, and, in some cases, to 
provide extra counseling and monitoring for those students.^ 

To estimate a county welfare department's average operating cost per experimental, two basic 
types of information were necessary for most program activities: (1) an estimate of the "unit cost" of 



^When adult schools and community colleges provided these services to the welfare department, they 
typically did so under special contracts known as "excess cost" contracts. In this analysis, these excess cost 
payments were included with the other fiscal data obtained on the county welfare department expenditures for 
GAIN. 
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each activity - i.e., the average cost of serving one person in a specified activity for a specific unit 
of time (e.g., one month), and (2) die average lengdi of stay in die activity (in die same time units) 
per experimental.^ Multiplying die unit cost by experimentals* average length of stay yielded die 
average cost incuixed per experimental. 

The first step in estimating a unit cost for each component was to collect welfare department 
expenditure information reported on the Administrative Expenditure Claim (AEC) forms that each 
county submits quarterly to CDSS."^ The information obtained covered approximately two or more 
years of program operations in each county. From these data, a period of three or four consecutive 
quarters (the exact number varied by county) was id^ ified as best capturing a time span in which the 
evaluation's experimental group made up a large snare, if not most, of the registrants in the GAIN 
program, and during which (to die extent possible) a relatively stable pattern of expenditures could be 
observed.^ This period is referred to in this discussion as the "steady-state" period.^ 

For MDRC's cost analysis, all expenditures pertaining to a specified GAIN activity (e.g., 
ABE/GED instruction) during a county's steady-state period were identified on the appropriate AEC 
forms and inflation-adjusted to 1993 dollars. This total was then marked up by a small amount to 
include a pro-rated share of CDSS costs for state-level supervision of die GAIN program in each study 
county. 

The next step was to divide this total expenditure by an estimate of the total number of 
"participant-months" for the activity. The number of participant-months was obtained by summing, 
across all montiis in the steady-state pericd, die mondily total number of participants in die activity. 



^A different approach was used for the category of orientation, appraisal, and assessment and for OJTs, 
For the former, the analysis multiplied the unit cost (i.e., the cost of the three components per appraisal 
session) by die average number of appraisal sessions per experimental. For the latter category, it multiplied 
die unit cost (i.e., die cost per OJT participant) by die percentage of experimentals who ever participated in 
anOJT. 

''On die basis of state-mandated, county-administered staff time studies and other criteria, county welfare 
departments allocate all of dieir expendimres across die variety of programs administered by die agency, 
including GAIN, and across a variety of GAIN functions as well. They report die allocations for each quarter 
on the Administrative Expendimre Claim forms. 

^Anodier criterion was that the period be one in which the overall number of GAIN registranu? who 
attended orientation and die overall number who attended program activities could be estimated widi a 
reasonable degree of confidence. 

^e steady-state periods were: October 1989 to June 1990 for Alameda; April 1989 to March 1990 for 
Butte; October 1989 to September 1990 for Los Angeles; October 1988 to September 1989 for Riverside; 
October 1988 to June 1989 for San Diego; and April 1989 to March 1990 for Tulare. It is important to note 
again that the patterns of expenditures and unit costs observed during these steady-state periods may not reflect 
current patterns because there have been changes in counties' implementation practices. 

^^For each county, CDSS costs were estimated to be 1 .9 percent of die county welfare department's GAIN 
operating expendimres. This estimate was based on data for the state fiscal year 1989-1990 obtained from 
CDSS. 

^^There were questions about the accuracy of some of the data presented on the state "GAIN-25" form 
pertaining to the aggregate number of GAIN registrants participating in specified GAIN activities during each 
calendar mondi of die steady-state periods used in diis analysis. For this reason, an estimate of participant- 

(continued...) 
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For example, if 10 registrants participated in ABE/GED activities during each month between January 
and December (whether or not they were the same people every month), the total number of 
participant-montlis for that year would be 120 (i.e., 10 x 12). Dividing the total expenditures by the 
total number of participant-months for the steady-state period yields the average monthly unit cost 
during that period - in other words, the average cost ascribed to one participant for one month. This 
implies, of course, that the accumulated cost ascribed to a given individual for the duration of her 
involvement in an activity will depend on how many months she participated in the activity. 

Thus, the final step in estimating the county welfare department's average cost of GAIN per 
experimental was to multiply the activity's monthly unit cost by the experimental group's estimated 
average GAIN-related length of stay (i.e., number of months participating) in the activity. The data 
used to estimate the duration of participation in each activity were the same as those used for the 
participation analysis discussed in Chapter 2, and the estimation procedures were nearly the same.^^ 

It is important to note that the unit cost estimates, though expressed in terms of cost per 
participant-month, actually included all the costs of staff efforts to follow up on nonparticipants who 
were assigned to a particular component. For example, if 2 out of 10 registrants assigned to an 
ABE/GED class failed to attend it, the time case managers spent trying to contact the nonattenders, 
to address obstacles to their attending, to cajole them to participate, or to invoke the formal penalty 
process all got charged - according to the rules of the state's time study in effect during the period 
covered by the cost analysis ~ to the component the registrant was expected to attend. In effect, then, 
the unit cost would reflect the fact that (using the same example) for every 8 people who attended an 
activity, the welfare department incurred the expenses of having staff work with another 2 who failed 
to do so. 

Estimates of welfare department unit costs for five of the seven main categories of GAIN 
activities are shown in Table 3.1, columns A (for job search, education, and vocational training 
activities) and B (for orientation, appraisal, and assessment). (Cost information on unpaid work 
experience and OJT is provided in the table's notes.) To illustrate: Column A in the left panel of the 
table shows that the estimated unit cost per participant-month incurred by Alameda's welfare 
department for ABE/GED activities was $180. The unit cost for ABE\GED varied widely, from a low 
of $94 per participant-month in Tulare to $288 in Los Angeles. In all counties, the unit cost for job 



^^(... continued) 

months was constructed for this analysis, using county data on GAIN orientations from the GAIN-25 forms 
and information on registrants' length of stay in each activity from MDRC's GAIN registrant survey. The 
county data on the number of orientation attenders were considered to be accurate during the steady-state 
period because they closely matched the number of registrants MDRC had randomly assigned during that same 
period. This, of course, also meant that most GAIN registrants during the steady-state period were in 
MDRC's research sample, and that the registrant survey data on participation pertained to the orientation 
attenders counted on the state forms. 

^^As described in Chapter 2, participation in employed-related activities by experimentals and controls was 
identified through a combination of GAIN program tracking data collected from county casefiles and registt:ant 
survey data. The main difference between the participation estimates presented in Chapter 2 and those used 
in the calculation of costs had to do with the way periods of nonparticipation were handled in estimating the 
duration of participation in a given component. For that reason, multiplying the unit cost estimate in Table 
3. 1 by average length of stay estimates presented in Chapter 2 would not yield the same (correct) estimates 
of average costs presented below in Table 3.2. 



-71- 



CO 

LU 
-J 

m 
< 



ERLC 



CO 
GC 



o 

Q 

« 
0) 
0) 



CO 
UJ 

t 
> 

o 
< 

a 

UJ 

5 

UJ 
CC 

I 



UJ 

3 

UJ 
CC 

o 

lo- 
co 

CO 

o 
o 



Q 
UJ 
I- 
< 

co 

UJ 



JO 

2 

o 
o 



ay 
c 

0) 

I 
o 

X 

UJ 



0) 

o 
O 

c 

?H 
o 
c 

0) 

< 

0) 

5 

\ 

c 
o 
z 



o 
c 

0) 

CO O 

c 
o 
z 



Q 
< 

0) 



a> S 

D) C 
CO o 

c 
o 
Q. 



CO " 

Q 
< 

0) 
Q. 



0) 


(/> 




o 


■•— ' 

(/> 


■•— ' 
C 


O 


O 


<0 




O 


a 


Un 


de 


rtici 






<o 
a 


len 


o 


_c 


c 






o 




o z 


<o *^ 




0) 3 


C 


Q 


-D 




0 


0) 


o 


S 


k. 


*o 




<0 LL 




§. 




3: 




o 



0) 0> CD 

CO 2 
> Q- 

<< 



8.1 i 

0)0 

2 I 

< ,9- 

o 

to 

Ql 



o 

Q. 

81 

c 

<0 

>t 
c 

3i 
o; 



(0 to ^ 3 TT 

^ O) O) O 

^ C O O CVJ 

CVJ CVJ CO 



to CO CO to 
c ^ c t 



to CO 0> 0> 
•^"^ O O lO 

CVJ CVJ CO 



lO CO CO to ^ 

r;; "c "c "c c 



to o o o ^: 

CVJ CO CO o 



(0! 
0) 

E: 

<l 



c 

CO 
0) 
(O 
CO 
CO 

T3 

c 
to 

CO rn 

.52 o 
(0 

<0 to 

dsz 

to LU o ^ 

iS 0) o BO 
C to to W 

0) o UJ -J <3 <D' 

= o m CO o 
O < UJ > 



to ; 
O I 

ob! 

2 ^1 

il 



to to O O 

o o o 

CVJ CVJ CO 



c c 



CO CVI CO CO 

"c 



to to CD CD ^1 

^ - ■ o o I 

CVJ CVJ CO 



c c ^ ^ 



LO CO CO CO CO 



CO r*. CVJ CVJ 
> o ^ ^ 

^ CD T- T- 



CVJ 
<3> 



0) 

g 

CO 
0) 
CO 
CO 

to 

■D 

c 

CO 



CO 



0) 

ti 
QD 



to 

.52 o 

CO 
«3 to 

c j:: 

O O Q 
(0 LU 

c to ^ 
(1) r» LU -J 
•1= O CD CO 

O °<uj 



I 

to 
o 

a c 

O -iZ 
D)g 
.£ 3 
C -D 
to 0^ 



■2 

o d) 
o ^ 

> 



CO OO CO CO C0» 



(0 CO -r- T- 
CVJ CVJ 



CVJi 
CO 



O CO CO 
CVJ 



c c c" 



COl 



CO CO CO CO CVJ 
>■ CO CO CD 

^ lO CVl CVJ T"! 



COS 

^ ^ 0)' 



0) 
D3 

c 

< 

col 

ol 



c 

0) 

§ 

CO 

CO 
CO 
CO 

"D 

c 

CO 

.52 0) 
CO 

Q.:> 

<0 CO 
O O Q 

*i CO UJ 

is <D o 

C £0 ^ 

0) r» UJ -J 

^ O CD CO 



1 

CO ! 

o 

oB 

c -o 
■Jo 0) 

l§ 

o « 

> 



CO CO lO lO 
CVJ CVJ 



2-1 



o 

o 



CO CO CO CO 



iO, 



CO CO O O 
CVJ CVJ 



CO CO CO ^ 



<0 CD T- T- 

CD ^J- 
^ lO 



CO 
CO 

CO 

•D 

c 

CO 



S CO 
CO 



0) 

■g 

"w 

ID 

> 



o o Q ? 

c CO to 

0) o LU _1 O 

- m CO o 

O lu > 



O -z: 
CO 



CO 

c 
o 
o 

0) 



0) 

c 

C 

o 
o 



CO 

-J 

QQ 
< 



ERLC 



o 

O 

c 

>i 
o 
c 

< 

5 

I 

c 
o 



Q 
< 

Q. 



D) C 

to o 

c 

Q. 
O 

CO 



a 

l2 



o 
c 

(0 o 
0) ^ 

5 Ej 



(D 
D) 
(0 

> 

< 



< 

Q 
< 



CO t/) cn 

O o cci 
.iii O 

E — oi 

Q. Q. CT 

0) 0) _ 

S -5^ Oj 

5: ^ o 



0) -c^ CD 
22* to 

< < 



0)0 



< g. 
o 
'■e 
«o 

CL 



11 

o 

Q. 

£. 
o; 
O! 

?l 

(0 

c 

13 
O 

O 



(0 (0 in in r*. 

<N <N CO 



(0 CO CO (0 to 



CO to CO CO 
CVJ CVJ 



in to to to 

^ "c" "c" "c" 



tOi 



to CO CO 

CO 

^ in CVJ CVJ 



CVJ- 



c 

0) 

E 

CO 
CO 
0) 
(0 
(0 
(0 

■D 

c 
to 



CO 

Q. > 
to m 



Oi 

cn 

to' 
CO 



Q Q 

C CO i<. 
w m CO 



OI 



Bo 

g s 

o 
> 



to to CO CO 
CO CO 

^ ^ o o 

CVJ CVJ 



to to to 
"c ^ "c 

^ CO ^ ^ 



tOi 



CVJ CO CO CO CO 

5 c 



CO r*- 

>^ CD CD CD 
^ CD 



c 



(0 
0) 
(0 

T3 

c 

CO 

CO en 
CO 



0) 
13 



o 

CO 

(0 LU 
CO ^ 

o LU -i 
O CD CO 
< LU 



w 
O 

Q- c 

.£ 13 
C -D 
CO 05 

g Si 

> 



-73- 



5 ^ 



"^cOO CVJ ^ 
CVJ CVJ CO: <y 



CO CO 

% - 

o o 

x: CO 

CO 

O O 

O Q) 



o 8 

JZ 

c 

CO 

CO 
- 0) 

JO eg 
^'^ 

in 0) 
CD 2 

CO 

0 CO 
(D 

to t; 
■o 5 
g £ 

1 « 

JO 0) 
< (D 

o £ 

E > 
o I 

<D X 
D) . 



O c 



I? 

E ?i 

O 



CL 
X 



c 
o 
o 
-n ^ 

CO XfJ 
CO o 

To o 

CO 

i ° 

1 D) 

§.« 

x o 
•O :£ 

So 

:■!=: 0) 

^ to' 
o — tl) 

CO _ 

(D (D 

CO > 
(D 

-C O 



CO 
CO 
■D 

<D 
C 

0) 

"C" -o 
-o a; 

sz ^ 

CO (C 

±^ <D 



4>-> jg 



O) 
c 



x: CD CO 
r. E.9- 

<D C O 
.25 CO (TJ 
<D CO 

2 

CO o ^ 



1 



CVJ 

in 

"S ^ ^ - 



.9> a. 

Ol o 



CD< 

^.^ 
3i CD 

CD 11 
O 0) 

■^^ 

^ CO 
CO 

B to 

CO 



CO ^ 

CO o 
I > 



CO 



0) 



O Jo 

CO ^ _ . 

<D ^ (0 *0 

O CD 0) CD 

n 13 

CL c 
X 

05 CO 



W = 
CD ^ 



3 

■o 

CO 

CO C) 
CD CO 
D) — 
^ CO 

"o i 

O O 
>. C 

c ^ 
13 D) 

E-i 

E 3 
o t: 
o 

E 

o B 

•= CO 
CO (u 

XI 1 

^1 

S CO 

2 o 
(0 E 

CD g 
E (D 
CD J2 

|8 

CO 

- to 

CD CO 

o 

to ^ 

0> Z3 

5 o 

< SI 



"to 
£ 

X - 
O JO 

CL O 

O CO 



^ CO 
CD CD 

" Ui 



CO ^ 

Q c 

<D CO 
to .ti 

|§ 

< < 



o g_ 

^ o 

*c tr 

13 CO 



O ^ CO 
g 0) CO _Q 

CO I- 5 

CO 



95 i= - P CD i2 



CO o 
< 

< E 

CD E 
CO o 
CD O 

CO 

. x: 

< r 

Q <D 

< JO 

. 

<D O 
Q. CO 

CD .2 

a. >. 

X ^ 
CD 

o 5 

CO SI 

E E 

-o Q- 

CD E 
CD 

« (O 



0) 



'-^ o 

CD O 
CO ^ 



CO Q. 

Its 
S 8 

0) CO 

■D 
- <D 

CO 

o 

Z CD 



O CD 
0) CO 



5: =5 

O SI 

> ^ S 

o o g 5 

*- > JS 

5 5 « 

o « £ 



1- 

c 

o 6 

CO CO 

^ I 

Q O 

< (O 

o> I 
c O 

--^^ 

CO CVJ 
ID 

o 

o 
o 

CO 



CO 

o'g 

s 0 

*i CL 

C CO 
CO JZ 

si 
I ^ 

IB 
E S 

o o 

o > 



search was the highest for any activity, reflecting the fact that it included the costs of providing the 
job search activities (e.g., of operating the job club sessions) in addition to case management. Across 
five of the six counties, the job search unit costs were quite similar, ranging from $537 in San Diego 
to $667 in Tulare. Alameda's unit cost was the highest, $1,120 per participant-month. 

Many factors can affect the size of the unit cost across activities and counties. These include 
registrant-to-case -manager ratios, the intensity of staff efforts to monitor registrants' participation, the 
degree of emphasis on personalized attention (which can involve more time-consuming, and hence 
more costly, interactions with registrants), the wage scales and other overhead costs in different 
communities (e.g., both may be higher in more urban areas), and a variety of special expenditures a 
county may make on behalf of registrants in certain components. For example, San Diego had extra 
on-site counselors in its learning labs for ABE/GED and ESL participants; Tulare and Butte had extra 
on-site counselors at some community colleges; Riverside made incentive payments to basic education 
providers; Los Angeles held a motivational training seminar, which was incorporated into its day-and- 
a-half-long orientation; and Alameda had an on-site day care center at the GAIN office for registrants 
attending a GAIN orientation and meeting with staff. 

Also critical is the number of participants relative to the program's capacity. Unit costs would 
be higher in a program operating under capacity (e.g., serving fewer people at any one time than its 
staff and facilities could handle) than in one operating at full capacity. Unit costs could also change 
quickly and substantially in response to a change in the flow of participants through the program's 
activities. For example, a sudden increase in the number of participants "on-board" in the program's 
job search component without a corresponding increase in staffing or facilities would cause unit costs 
to drop sharply. 

The size of a county's unit cost for a particular component was not the only factor that 
determined the welfare department's average cost per experimental for a given GAIN activity; the 
other determining factor was the per-experimental average length of stay in the component. A short 



*^The welfare department unit costs in Los Angeles during the time the MDRC research sample was 
studied may have been somewhat higher than at a later period because, at the earlier point, the program had 
excess capacity (unused furnished space) because the California state legislature had imposed a cap, for the 
period from July 1989 to June 1990, on the amount of money the county could spend on a case management 
contract if it contracted for these services. The county used a private firm, and the existence of the cap, which 
was in effect during the steady-state period selected for this evaluation, limited the number of people Los 
Angeles could register for GAIN. 

The analysis partly compensated for this problem by using a longer steady-state period for the 
orientation, appraisal, and assessment category. The longer period included the time after tlie cap was lifted, 
when the number of people attending orientation in a given month increased considerably, bringing down the 
average unit cost of orientation. Although many of the registrants who took part in GAIN orientations in the 
later period were not part of the research sample, there is little reason to expect that the nature of the 
orientation and appraisal process had changed in ways that would have affected recipients' subsequent 
participation in the program or in the labor market. However, the registrants attending orientation after the 
cap was lifted were not included in the MDRC research sample, and the county's own GAIN-25 data suggest 
that their participation patterns may have differed from those of the people who were included in the MDRC 
research sample. Therefore, unit cost estimates for program activities other than orientation, appraisal, and 
assessment were all based on a steady-state period that ran from October 1989 through September 1990, when 
most program registrants were also members of the research sample. 
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average length of stay could keep down the average cost per experimental even in a program where 
tlie unit costs were relatively high. 

Table 3.2, column A, presents the average cost of GAIN incurred by the welfare department, 
per experimental, in each county for each activity. (In Figure 3.1, this is represented by box 1, 
excluding support service costs.) The operating cost per experimental for the six counties combined 
was $2,317, as shown by the subtotal line in the last panel of the table. These costs were fairly similar 
in Butte, Riverside, San Diego, and Tulare, at approximately $1,600 to $2,100, but much higher in 
Alameda ($3,273) and Los Angeles ($3,296). 

The bulk of the county welfare departments' operating costs were spent on case management 
activities. These included the time spent on orientation, appraisal, and assessment as well as ongoing 
case management, which involved assigning registrants to activities, arranging support services, 
responding to noncompliance, communicating with outside providers, maintaining case files on 
registrants, etc. While the available data do not permit a precise estimate to be made, a reasonable 
approximation would be that case management accounted for about three-quarters of county welfare 
department GAIN operating costs per experimental (and about 60 percent of welfare department costs 
after adding in support service costs). 

B, Child Care and Other Support Service Costs (Figure 3.1. Boxes 1 and lb) 

The overall cost of GAIN included payments for three types of support services to help 
registrants participate in GAIN activities, as listed in box lb in Figure 3.1: child care costs, 
transportation costs, and ancillary services (i.e., miscellaneous employment or training expenses such 
as uniforms, work shoes, tools, equipment, books, and registration or licensing fees). Individual-level 
data on support service expenditures were collected from county fiscal records for a representative 
subsample^** of experimentais in each of the six counties, covering a period of 25 months after GAIN 
orientation in Alameda to at least 50 months in San Diego. For the remainder of the five-year time 
frame used in this analysis, it was necessary to project support service costs for a period ranging from 
6 to 10 months in San Diego to 35 months in Alameda. 



Alameda and Los Angeles support service payments data were collected for nearly all experimentais who 
were included in the impact sample (593 and 2,995, respectively; from the counties' automated tracking files. 
For the other four counties, support service payments for experimentais in representative county samples (1 14 
in Butte, 214 in Riverside, 2,238 in San Diego for child care and 132 for transportation and ancillary support 
services, and 175 in Tulare) were obtained from county data bases and spreadsheet files, casefiles, and other 
fiscal records. 

^^The support service payments data covered a period of 49 months in Butte, 48 months in Los Angeles, 
39 months in Riverside, and 47 months in Tulare. In San Diego, data on payments for transportation and 
ancillary services were available for 54 months, and data on child care for 50 months. 

^^Support service costs had to be projected for approximately one year in Butte, Los Angeles, San Diego, 
and Tulare, and for approximately two to three years in Riverside and Alameda, respectively. These 
projections were made by multiplying the observed average monthly payment amount by an estimate of the 
average length of participation in GAIN activities during the projection period. In Alameda and Los \ngeles, 
monthly support service payments data were not available in a form that could be readily used for this 
evaluation, so the average of those payments in the other four counties (which did not vary) were used as 
proxies for the monthly estimate in Alameda and Los Angeles. 
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Table 3.2 presents the five-year estimated support servi-^^e expenditures per experimental 
(column A) and shows the percentage of each county welfare department's overall GAIN cost 
attributable to support services (column B). For example, the estimated cost of child care in Butte 
averaged $156 per experimental, accounting for about 6 percent of the overall cost incurred directly 
by the Butte welfare department (column B). This is close to the all-county estimate of $225 per 
experimental and accounted for almost 8 percent of the GAIN costs incurred by the county welfare 
departments, as shown in the last panel of Table 3.2. 

Table 3.3 provides more detailed information on support service costs. Column A shows the 
proportion of the experimental group who ever used the various support services. For example, across 
all six counties (as shown in the last panel of the table), only about 14 percent of experimental ever 
used child care that was paid for with GAIN funds while they were participating in the program. 
Column B shows the average amount of money the counties paid in a typical month per person for 
whom a payment was made in the month (e.g., $180 for child care), and column C indicates the total 
amount spent during the five-year period per experimental who used a specified support service (e.g., 
$1,229 for child care for those that used GAIN child care funds). Columns D and E present the 
support service costs that were observed and projected per experimental (i.e., averaged over all 
experimentals, including those who never used any support services). The average observed and 
projected amounts together sum to the five-year totil cost per experimental (column F), which was 
$225 for child care, $261 for transportation expenses, and $97 for ancillary services for all six counties 
combined. (It is important to note that the five-year support service cost estimates are less certain in 
counties such as Alameda where the projection period is so much longer than in other counties.) 

Finally, colunm G indicates the percentage distribution of support service costs by type of 
service. It shows that, across all six counties, child care accounted for about 39 percent of the per- 
experimental cost of all support services provided as part of the GAIN program, while transportation 
accounted for 45 percent, followed by ancillary services at almost 17 percent. Transportation cost 
more than child care per experimental because a much larger proportion of the experimental sample 
received transportation payments (57 percent) than used GAIN-funded child care (14 percent), as 
indicated in column A. However, as expected, the cost per person receiving transportation payments 
($387) was much lower than the cost per person using child care paid for by GAIN ($1,229), as 
indicated in column C. 

When the support service costs are compared across counties. Riverside's costs stand out as 
much lower than other counties' average expenditures for these services. This appears to be due to 



^^The finding that only 14 percent of GAIN experimentals (across the six counties) used GAIN-funded 
child care is comparable to the rate estimated by MDRC in an earlier special study of GAIN child care in a 
different sample of California counties (although over a shorter follow-up period). In that study, 
approximately 13 percent of orientation attenders responding to an 18-month survey reported having used 
GAIN child care funds. (See Maitinson and Riccio, 1989.) Some of the same explanatory factors probably 
apply. According to the earlier study, most of those who did not use GAIN-funded child care did not meet 
the criteria for receiving it. For example, a large number of orientation attenders did not participate at all 
in GAIN activities, in many cases because they were deferred on the grounds that they had part-time 
employment or for other reasons, or because they left welfare before attending a GAIN activity. Even among 
participants, the need for child care was not universal. Many were determined not to require any child care 
assistance because their youngest child was at least 14 years old or because all of their GAIN activity took 
place while their children were in school. 
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the shorter length of time that Riverside's experimentals participated in GAIN activities. Table 3.3 
(column B) shows, e.g., that Riverside's average monthly child care payment ($165) was not 
substantially lower than other counties' average monthly payment (e.g., it was only $19 lower than 
Tulare's average of $184). Moreover, the proportion of Riverside experimentals ever using GAIN- 
funded child care was close to the rate in at least some other counties (e.g., 9 percent compared to 
about 11 percent in Tulare). However, the cost per person using GAIN funds for child care was much 
lower in Riverside (e.g., $470 compared to $1,288 in Tulare, a difference of $818), indicating that 
the average length of time those funds were used was less than in other counties. 

It is important to note that, across all six counties, the average cost of GAIN child care per 
experimental, while substantial, might have been higher still if the research sample had been composed 
mostly of parents with younger children, a group that has a greater need for child care. For those with 
schoolage children, GAIN activities were often scheduled to take place while the children themselves 
were in school. Also, those whose youngest child was a teenager (up to about one-quarter of the 
research sample in some counties) would not have been eligible for GAIN-funded child care. 

C. Transitional Child Care 

Under JOBS rules, welfare recipients are entitled to receive transitional child care assistance 
from the county welfare department if they leave welfare for employment and meet other criteria. 
However, because people who leave welfare for en.ployment are eligible for this assistance regardless 
of whether they were ever in the JOBS (i.e., GAIN) program, transitional child care is not considered 
in this analysis to be a GAIN-related cost. At the same time, GAIN could have affected transitional 
child care payments to the extent that it increased the probability of people leaving welfare for 
employment, and to the extent that it increased welfare recipients' awareness of the availability of this 
benefit. In this sense, transitional child care might be thought of as a "complementary" rather than 
a direct cost of GAIN, and, therefore, appropriate to consider in an analysis of the overall cost of 
serving experimentals. 

The data available for this study did not permit an accurate estimate to be made of the average 
value of county expenditures for transitional child care per experimental and per control. However, 
several types of information indicate clearly that the actual amount was very low.^^ For example, 
according to the registrant survey, it appears that roughly 1 to 3 percent of all survey respondents 
reported using transitional child care within the two- to three-year survey follow-up period. Data on 



^^This is consistent with the participation findings discussed in Chapter 2, which showed that, within the 
first 1 1 months of follow-up, nearly 79 percent of Riverside's AFDC-FG experimentals had deregistered from 
GAIN, while in other counties the rate ranged from 28 percent in Alameda to 57 percent in San Diego (see 
Table 2.12). 

^^DRC's 1989 study of GAIN child care found a similarly low use of the three-month transitional child 
care that, prior to JOBS, was offered as part of GAIN'S support services. Although the exact reasons for that 
low usage rate could not be determined, the report identifies a number of factors that may have contributed 
to that result, including the fact that some orientation attenders in that study did not become eligible for the 
funds (e.g., they did not leave welfare for work), some who might have been eligible said that they did not 
need the assistance (e.g., perhaps they worked part-time while their children were in school), and some may 
not have been adequately informed about their entitlement to transitional child care. See Martinson and 
Riccio. 1989, pp. 72-77. 
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receipt of this assistance were also collected directly from the county welfare departments for 
experimentals and controls in Butte, Riverside, and San Diego. These results, too, reveal little usage: 
by none of the experimentals or controls sampled in Riverside, less than 1 percent of experimentals 
and controls in San Diego, and possibly up to 2 percent of experimentals (but no controls) in Butte.^^ 
(It is possible, of course, that a somewhat greater proportion of experimentals and perhaps controls 
used transitional child care over time as more and more of them left welfare for work.) 



HI. The Cost of GAIN to Non-Welfare Agencies (Figure 3,1. Box 2) 

Non-welfare agencies - adult schools, community colleges, and other organizations ~ provided 
the education and training for GAIN registrants who were assigned to basic education classes, 
vocational training, and post-secondary education to meet their participation obUgation, or who were 
participating in approved self-initiated activities begun prior to entering GAIN. Thus, the expenditures 
made by the non-welfare agencies to serve GAIN registrants are considered to be GAIN-related costs 
(as illustrated in box 2 of Figure 3.1), even though they were not controlled directly by the county 
welfare departments.^^ 

To estimate the per-experimental average of these costs for each county, it was first necessary 
to determine the appropriate unit cost for each activity. Provider unit costs were estimated separately 
for ABE/GED, ESL, and vocational training or post-secondary education, and covered operating 
expenses but not support services. They were based largely on expenditure data for community 
colleges and adult schools (the main providers) and for ROC/Ps, all of which were obtained from the 
Chancellor's Office of the California Community Colleges and the California State Department of 
Education. These expenditures are expressed in terms of the average cost per unit of Average 



^^n Butte, transitional child care payment data for the 12 months from April 1991 through March 1992 
was analyzed for the full AFDC-FG sample of 986 experimentals and 243 controls used for the impact 
analysis. County records indicated that seven experimentals and no controls received transitional child care 
payments. In Riverside, a random sample of 595 experimentals and 200 controls was matched to transitional 
child care payments for the period from July 1990 through April 1993, but no payments were found. In San 
Diego, transitional child care payment data were obtained for a subsample of 195 registrant survey sample 
members who said they had left AFDC for employment. Of the 195 sample members, one experimental and 
on control received transitional child care payments between April 1990 and March 1993. 

^^Some of these expenditures included California Department of Education, JTPA, and California 
Community Colleges monies that were earmarked by the state legislature for serving GAIN registrants. Until 
July 1990, these sums were counted as "community resources" in the state's GAIN budget. 

^California Community Colleges data were obtained from the 1989-90 Fiscal Data Abstract of the 
Chancellor's Office. County numbers were calculated from accumulated district-level numbers. Results were 
inflation-adjusted to 1993 dollars. California State Department of Education data on adult schools were 
obtained from the Education Finance Division (ADA statistics) and from the School Business Services Division 
(Adult School Fund expenditure reports) and the Budget Office (estimated state-level expenses). Fiscal year 
1991-1992 data were used for calculations and the results then were inflation-adjusted to 1993 dollars. 

The registrant survey indicates that some participants in vocational training programs are likely to have 
received their training at institutions other than community colleges and adults schools. These instimtions 
could include a great variety of proprietary schools, community-based nonprofit organizations, and ROC/Ps, 
in many cases using JTPA funds to help pay for the services. (Community colleges and adult schools also used 
JTPA funds.) Because data were not available on the acmal cost of services provided by these other 

(continued...) 
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Daily Attendance (ADA), where one ADA unit represents 525 hours of attendance. (One ADA unit 
can be thought of as the total course time for a full-time student during a normal academic year,)^^ 

Table 3,1 presents the unit cost estimates for ABE/GED, ESL,^"* and vocational training and 
post-secondary education (see column C).^^ As the table shows, the estimated unit cost of ABE/GED 
and ESL instruction for experimentals was over $2,100 per ADA in all six counties. For vocational 
training and post-secondary education, unit costs were considerably higher, ranging from $3,011 in 
Butte to $3,522 in Riverside, 

Once the provider unit cost was estimated for a given activity, it was muhiplied by a 
corresponding GAlN-related length of stay estimate per experimental, with the average number of 
months participating transformed into an estimate of the average number of ADA units of participation 
per experimental,^^ This yielded the estimated non-welfare agencies' GAIN cost per experimental. 

The results are presented in column C of Table 3.2. As shown in the last panel, non-welfare 
agencies spent about $1,515 per experimental for all GAlN-related activities across all six counties. 
This is about half the total GAIN cost of $2,899 per experimental incurred by the county welfare 
departments directly (column A). 



^'^C... continued) 

institutions, the analysis used the average community college, adult school, and ROC/P cost per hour to 
approximate their unit costs. 

^•^For example, a community college student taking a full complement of courses that meet for three hours 
per day for 175 days would account for one ADA unit. A part-time student taking half of a full course load 
would account for one-half of an ADA, etc. 

^"^Data available on community colleges and adult schools did not permit the unit cost of ESL to be 
estimated separately from the unit cost of ABE/GED instruction. 

^For ABE/GED and ESL, the unit costs in each county reflected the average of the community college 
and adult school unit costs for basic education, since both types of institutions provided basic education 
courses. However, these costs were weighted according to the proportion of the participants in the 
experimental group who used each type of provider. The relative use of different types of institutions was 
determined from respondents' answers to a question on the registrant survey asking them to indicate the type 
of institution they attended for each activity. Separate weights were used in each county to reflect county 
variation in the frequency of relying on conmiunity colleges versus adult schools for basic education courses. 
A similar weighting scheme was used in estimating the average unit cost for vocational training and post- 
secondary education, since adult schools and other institutions as well as community colleges provided those 
services. 

County-specific data on average community college expenditures per ADA were obtained for the six 
counties in the study. However, unit cost estimates for adult schools and ROC/Ps were based on statewide 
averages. 

^^Because one unit of ADA is 525 hours, an hourly cost can be determined simply by dividing the cost 
per ADA by 525 hours. Thus, using Riverside as an example, the estimated hourly cost is $4.11 for basic 
education instruction and $6.71 for vocational training and post- secondary education. 

^^This transformation was made partly by using information on the average number of hours per week that 
participants were scheduled to participate in each activity, as reported on the registt-ant survey. Other 
adjustments were also made in an effort to estimate the average number of ADA units per experimental in a 
manner that was consistent with the definitions employed by the community colleges and adult schools. 



-84- 



IV. 



The Total Cost of GAIN per AFDC-FG Experimental (Figure 3.1. Box 3) 



As previously explained, the total cost of GAIN per experimental (box 3 in Figure 3,1) was the 
sum of the county welfare department's and non-welfare agencies' GAIN-related costs per 
experimental. This overall cost can be seen in column E of Table 3,2, For all six counties (the last 
panel), the sum was $4,415 per experimental. The percentage distribution in column F indicates that, 
of this total, almost 87 percent was accounted for by operating costs, another 5 percent was accounted 
for by child care expenditures, and another 8 percent by other support services (i.e., transportation 
and ancillary costs). 

Table 3,2 also shows that the total cost of GAIN per experimental varied widely across the six 
counties. Four counties - Butte, Riverside, San Diego, and Tulare — had an average cost in the 
range of about $3,0(X) to $4,(XX), while Los Angeles spent more than $5,900 per experimental and 
Alameda, more than $6,600. (Figure 3.2 illustrates the differences across counties in the distribution 
of the total cost of GAIN by type of GAIN activity or service,) The unusually high costs in Alameda 
and Los Angeles (both of which served only long-term welfare recipients) are largely attributable to 
their experimentals' relatively lengthy stays in education and training activities. This can be illustrated 
by comparing both unit costs and total GAIN costs for education and training activities in Riverside 
and Alameda, Table 3,1 shows, e.g,, that the county welfare department's unit cost for ABE/GED 
in Alameda exceeded Riverside's by only $39 per participant-month ($180 compared to $141), 
Moreover, the basic education providers' unit costs were actually higher iu Riverside than in Alameda 
($2,160 compared to $2,109), Yet, as shown in column E of Table 3,2, the total GAIN cost per 
experimental for ABE/GED was much higher in Alameda ($1,644) than in Riverside ($432). This 
difference derives from the fact that experimentals in Alameda were more likely than their counterparts 
in Riverside to start ABE/GED activities, and to remain in them longer once they began them (see 
Chapter 2),^^ (This was true also in Los Angeles, where the cost of basic education was even higher 
than in Alameda,) 

Alameda also stands apart from Riverside (and all other counties) in its higher expenditures per 
experimental on GAIN-related vocational training and post-secondary education: $1,957 compared to 
$776 in Riverside (Table 3.2, column E), Again, this difference mostly reflected the wide variation 
between the two counties in the rate and duration of participation in these activities by experimentals 
while they were in the GAIN program. 

Longer participation in activities also produces greater expenditures for support services. For 
this reason, it is thus not surprising that Alameda's average child care expenditures ($433) and other 
support service costs ($713) exceeded those in Riverside ($57 and $111, respectively).^^ 

The differences in total GAIN costs betv/een these two counties thus reflected the different 



^^See Chapter 2 for a comparison of county differences in length of stay in each activity. It is important 
to note, however, that the actual length of stay estimates presented in that chapter differed somewhat from the 
estimates that were used in the cost analysis. In estimating county welfare department costs, the cost analysis 
had to include adjustments so that length of stay would be defined in exacdy the same way that participant- 
months were defined in calculating the unit cost estimates, 

Alameda's higher child care expenditures may have also been the result of a larger proportion of single 
parents with children under age 6 in that county's research sample. See Chapter 1. 
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FIGURE 3.2 



PERCENTAGE DISTRIBUTION OF THE ESTIMATED FIVE-YEAR TOTAL COST OF GAIN 
PER AFDC-FG EXPERIMENTAL, BY SERVICE COMPONENT 
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approaches they took in operating GAIN, which were described in Chapter 2: Alameda*s emphasis 
on building registrants' human capital through education and training versus Riverside's emphasis on 
moving registrants into the labor force expeditiously. In Los Angeles, the high rate and duration of 
participation in basic education activities, in combination with a higher county welfare department unit 
cost for those activities, accounted for much of diat county's comparatively high GAIN cost per 
experimental. 

V. Total Gross Cost (for GAIN and Non-GAIN Services) per AFDC-FG Experimental (Figure 
3,1. Box 5) 

GAIN activities were not the only employment-related activities experimentals used during the 
follow-up period. As discussed in Chapter 2, some experimentals entered vocational training and post- 
secondary activities on their own after leaving the GAIN program. Because these services have the 
potential to increase experimentals' longer-term earnings and reduce their use of welfare, it is 
important to count their cost in estimating the total government investment on behalf of the 
experimental group. It is that total investment - referred to in this analysis as the total gross cost per 
experimental - that must be compared to the total gross cost per control in order to determine the 
government's net investment per experimental and, in the benefit-cost analysis, the net payoff of that 
investment. 

A. Non-GAIN Cost per Experimental (Figure 3.1, Box 4) 

To estimate the average non-GAIN cost per experimental for employment-related activities in 
each county, the analysis followed the same principles that were used to estimate GAIN-related 
expenditures by non- welfare agencies: The provider unit cost for the specified activity was multiplied 
by experimentals' average length of stay in the activity. The results are presented in column C of Table 
3.4. For all six counties, the average cost of all non-GAIN activities was estimated as $480 per 
experimental, as shown in the last panel of the table. Colunm D indicates that most (87 percent) of 
these costs were for vocational training or post-secondary education. Overall, the average cost for 
non-GAIN activities varied only modestly across the counties, from $355 per experimental in Alameda 
to $689 in San Diego. 

B. Total Gross Cost per Experimental (Figure 3.1, Box 5) 

The total gross cost per experimental of all employment-related activities (Column E of Table 
3.4) was determined by adding the non-GAIN cost per experimental (column C) to the total GAIN cost 
per experimental (column A). The six-county average, as shown in the last panel of the table, was 
thus $4,895, of which $4,415 (90 percent) were GAIN-related expenditures. 

The top graph in Figure 3.3 illustrates the proportion of each county's total gross cost per 
experimental (represented by the full bar) that was accounted for by the welfare department's GAIN- 
related expenditures (the shaded segment), non-welfare agencies' GAIN-related costs (the cross-hatched 
segment), and non- welfare agencies' non-GAIN costs (the white segment). The bottom graph presents 
the same information, but in percentage terms. In every county, the combined GAIN-related 
expenditures by the welfare department and non-welfare agencies accounted for most of the total gross 
cost per experimental. Non-GAIN costs comprised a larger share of that total (10 to 18 percent) in 

-87- 

ERLC 



CO 
Ui 

OQ 
< 



1 ^< 

o I 
i o-D 

1 o§ 

£< 



z 

LU 

CL Z 
UJZ 



u. 



0. 



So 

gl uj 

Om 
o . 

« Q 

OH 

a:< 

<^ 

go 
a Lu 

zco 

?s 

z^ 

zz 

<x 

LU 



[IT 

<^ 
c 

0) 

E 

0) 
Q. 
X 
LU 



o 
w c 
O 0) 

O OJ 

is? 

o 



C 0) 

^ m< 

oil 

_ 0)$ 
0"D| 

OS 



0) c 

(0 



I 



0) CO ! 

< (1) 

Q. 
X 

UJ 



! 



<1> ^ rn 



c 

0) 

E 
5 

Q. 
X 

UJ 



^ O 

rvl h*.' cvj 

.r- CM 



C\J o 
cvj d d CO 

00 CO 



incoo)0) 01003- 

1- CO O ^ LO CM CVJ 

-r- iO ^ CVJ 00 

^ T- CVJ 10 



TO CVJ O 

d d d 



CO CO N. 

.r- 

T3- o) 

(O 



00*^0 iqooo 
dcvjihd cviddd 
CO o 



o o 
to 



CO o o 10 

CVI CO 



i^^ CVJ 

CVJ 



in CO 05 

.1- IV. 
10 1- (D 



0> O O CVJ 
CVI 00 



10 O CO 
10 CVJ CO 
O) 

^ 10 



000 
odd 
o 



O O If) 

10 

CO 



COCOGOCO LO^plO f*-.0Op 



(D O O 

T- O 



CO CO CVJ i 
1- CVJ. 

r*. CO: 

CO 



cvjocqio wcp'r-co 
cvi cvi cd d .r-^ d 



CO 



00 



10 -»-: o 
CO* d d 



rv.oooo> inoin^ 
csj r-. 10 CO CO }0 

CD If) 10 CVJ h*. CO 

T- CO 



CD CO CO 

10 O 

T- 



O O CO 

d -r^ CVJ 



o m CVJ T- 
00 



CO o o o 
d d d d 
CO o 



CD o o 
o in 



op CO TO p 

in CO 



p 00 C3) 
CO 1-^ d in 

CO CO 



r^incDco ooino 
CVJ CD CVJ CVJ r*. o 
CD in in CVJ CO ^ 

f- CO 



0) 

c 

c 
o 
o 



OOP 

d d d 



o o 

in: 



p CVJ p: 
CO d di 

y- Oi 



CD CO O); 
in o ini 



ERIC 



CO 
LU 



II 

E! 

O' 

Oi 

■D 



c: 

o! 
O. 



c 

0) 



0) 



c 

CO 

03 ^ 

g o Q 

CT3 UJ 

'^^^ 
^ O CD 



CO 



O 

C5 
O 

O Q> 
Ui >v 

■|§ 



Ui 

0) o 



c 
o 

—J o 
CO o 
UJ > 



X C (D 
0) 0) Q. 

E 

3 O 



c/) 
0) 
g 

0) 
c/) 

CO o 
D. 
0 Q. 

O O 



0) 

E 

CO 
CO 

a> 

CO 

CO 

to 

■o 
c 

CO 

.52 (D 
CO 

Q.:> 

«5 CO 

c 

O OQ 

COUJ 



3 
CD 



c 

g 

O (D .0) 
D) >^ 5 

.£ CO 
C TJ 

c 



i3 

CO 

O 
O 

c 



CD 
CL 
O 



X c 



5 

1 



o ^ -o S 0 

CD ^ ^ 

0-8<uj> 30 



O 



CO 

CD 
g 

<D 
CO 

8. 

Q. 

CO — 

6 



-88- 



o I 

II 

£< 



CD 

0 0) 
O 

1 0) 

o 



O 



c w 

SS-I 

^ <D S 

< J;; — 

— <W > 
<^ S 



8g 



05 + 

> — 
< S 
c 

0) 

E 

0) 

i2 



si 

*- en 



Q> CO 



< 0) 
X 

LU 



D)CE 

II 



9J E 



< O 

Ol 

X 

LU 



c 

0) 

c 
o 

E 
o 
O 

■D 
C 

>^ 
c 

13 

O* 
O! 



00 0> Cvj <D 
CO 



O 0> CO CO 
CM CO CO CO 

m lo o o 

CNJ 



fv. o q CD 

4\i CD d CD 



O O O lO 

If) 

NT CD 



O) in q 
o 



CO C\J 
-r- 1- o 
CO 

(O 



o q T- T- 
C3 C3 



o o r*"- 



O) o o q 
^ d 6 o 
c;> o 



o o 

CO 
CO 



o o q 
odd 



o O 00 



CO lo q 

CO o> ^ 1^ 
CO 



CO o q o) 
d d 



o> q| 
If) (d di 



OC;>CDCD cDoor^ 

CM CO (D (D in 

m m o o o CM 

CM -r- in 



CO '^i 
CO! 

CO 0)1 

inl 



0), 
Oi 

<i 



c 

0) 

E 
(/) 

CO 
Q> 
0) 
(/) 
03 

T3 
C 

to 

.52 0) 
oj 

Q..'> 

«3 OJ 
C ^ 

Q ^ 

B S 
c w 



Q 
LXJ 

(D 
m 

m CO 



c 

o 

O 0) 

13 O 

o 0) .9^ 

D) >» 0) 
O 

8 o 

CO $ 



03 



-^<LiJ> 



Q- c 



i9 
(/) 
o 
o 

D) 
C 

c ^ 
.5^ OJ 



CO 
0) 

g 

0) 
w 

OJ ^ 



(/) - 



CO 

O 



OO 



Q)' 

> 



q ^ o 
CD in CO in 



O CO 

(D CO (D h»- 
lO CO 1- 



q CM t- CM q CM o 
in d d in -r^ co d 



CO 0) CO ^ O) 

CM o in (D 

CM CO 

1- CO CO 



O CM O 

d cvi d CO 



o '<~ CM tn 

^ CO 



q q q 
CO d d d 

CO o 



O O <D 

in 



o o o 
d d d 
o 



O O CDj 

O t 

in; 



C3) q q q 

CO CO ''cr ir! 

1- CM 



o r*- CM CO 
CO in CO tn 
tn CO 



CM q ^ q q q 
CD d d -r^ CO d 

CM C3) O 



CD C7> CO in 



N. 



CM 



r*. CO 
in (D 

CM 



C 
0) 

E 
w 
cn 
0) 
cn 



c 

03 

Is W 

OJ 

cl:> 

<0 OJ 



c 

o 



O O Q 
^ 03UJ 
/— /ft 



ir o 



-> < 



03 
O 
13 

1- -o 
O CD 

D) >^ 
.£ S 
C -D 

■|§ 
If 

.'■^ S 

CO O 
LU > 



B 
<n 

<D O 
0) O) 

^ '-^ 

^ E^ 
> 

y) "5 
*0 to 
-15 03^ 

c CO 
D O 



CO 
0) 

o 
2: 

0) 
(0 

o 
a 

13 

05 — 
OJ 



q q q q 
CO to in 



q q Tj; CM 
-r-^ CM d d 



o 



CD CO r*. in 

CM C3) T- O) 
CO CD CO 



in CO r*- in inco oo 

o CO CM in 1- 

<D lo CM 1- c;> 

t- CO crs 



q in q 
d cd 00 



o o in CM 

f- CM 



q o q q 
CO d d d 
oo o 



o O O) 
1- CD 
CD CD 



o o ql 
dd di 



O O O) 
(O 

CDI 



^ q 

d ^ in 

-r- CM 't- 



oo q ^ 
d CM d CO 

CO CO 



q q q 
d 
o 



(DcocMco cotor^r*- mcoo 
cMcor^h- C3)r*.'»-^J" cm in co 



CO CO in 



CO 
CM 



CM 1- CM 
CO 



0) 

i 

CO 
<D 
CO 



CO 

03 '.^ 



■2 ^ 

CO 

o 
o 



IP 0) * 

oo 



o- 

D3 

0); 



031 

co; 



Q.:> 

S-c3 

<0 03 



13 O 
O 0) 



c 



0) 



•b 03 



X C 0) (O 

C <1> Q. ^ 

S o-^ E o; g 

o Q ^ § i .§) « 2 

*^OSUJ k| COf< 03 

O ° <LU > DO 



o 

CL 
CL 

13 i 

(0 — 
OJ 



OO 



c 

o 
o 



ERLC 



-89- 



^5 
o I 

II 

o< 



c 
o 

CO 

LU 
-J 
m 
< 



o 

CO c 
O 0) 

if 

o 



II 



(D 
.| 

0) 

CL 

LU 



o)oQ 

II 



< £ 

CL 
X 
LU 



C cn 



Q 0) 



OTJ 



ERIC 



0) C-SH 

II i 

O 

5.55 t 

i 

0) CO 

5 0) i 

11 i 

< 5 ! 

LU 



c: 
0) 

c. 
o 

QJ 

E- 
o 

o, 

i! 

C 
13 
O 

O 



1- CVJ CO CO 



CO CO O CO 

CO S 

T- CO 



CD q 

CO CO o 

o 



j 

CVJ O C?)i 

m in CO! 

'T- CO 



O O CO CO 
d LO 

-r- 1- CVJ 



CO CM 

CO CO CO 

r*. o CO 



O) N; T- T- 

cvi d d CO 



CO CO pi 

di 



OJ CO LO OJ m CD lO 

^ CO cvj IT) c;). 

CD CO CVJ CO CO 



p N; N; P 

d d c7> d 



CO o o p 

dado 
o 



O O p; 

odd; 

O: 



p C?3 CVJ 

d O) cvj 



O CO o o 
C7> 



lO O O C3> O O (3> 

(D in in 

CO ^ 



O CD lO ^ 



■•-OOP 

1^ d d d 

CO o 



CO o o o 



OOP 

d d d 
o 



o o o 

CO 



coc3>cc>c:>> pin^-in ^--^p' 
dcvjcod cdddcD -^ctjc 

1- CVJ CVJ CO o 



CO O C7) CD 
CO CO CO o 
CO ^ CO 



CD C7) CD CVJ CD ;r- 

f- CM tn in 00. 

o CVJ f- CO 

T- CO CO 



TT -r^ CVJ 

■r^ CD CO CO 
1- 1- CVJ 



CO CO CM -^T 
CO CVJ CVJ CD 

Nj- r*- o CO 



CO oq 
d d CD 
CVJ CO 



^ CO in CM 

C7i CO CO 

T- CO 

y CO 



T p 
in CO d 



tn CD in 
CVJ in 
CVJ CO 



c 

i 

m 

0) 

CO 
CO 

CO 

E 

to 

Is 

CO V-* 

£l:> 

« CO 

c -c 

o S£ Q 
•«g CO LU 

c CO ^ 

.5^ -Q W 
w o CD 









g 




B 






CO 


o 


CD 


O 


13 


O 


o 


O CD 


nen 


O) 

c 



CD 

CL 



Eo 



Q > -o S 5 

CO «0 ^ 

CO O CO 

UJ > 3 O 



CO 

CD 
O 

^ 
CD 
CO 

tr 
o 

CL 
CL 
3 

CO — 

- i5 



C 

§ 

CO 
0) 
CO 

c 
CO 



o o 



CO 

Q..> 

«5 (0 

O O Q 

CO LU 

iS CD (5 

c CO 5^ 

(D o UJ _J 

-Q CO CO 

O < UJ 



c 

.Q 

"to 
o 

13 
O Q) 

.£ 5 
I 



i5 

CO 

O 
O 

c 



CO 



c 
o 

« 1 

o ^ 

> 



CD 

X C 0) 

CD CD Q. 

E ^ 

i i^'Jo 

"D CO H 

C ^ CO 
=)0 



CO 
0) 

o 

'E 

0) 
CO 

t: 
o 

CL 
0 CL 

o o 



CO 
0) 

CO 

h- 

<D 
O 
CO 

LU 

o 
o 

CO 



-90- 



S CO ^-D 



CO « 

-11 i § 



-= o 

- CD 
o o ^ 

-■^ jr o 

h- ^ c 

73 CD «3 
O CO en o 

o lo u 

^ -fi CO 



CD c: 
E« 

ay 

O 5 

Gl 

X 
CD 

5 

CL 



CD 



CO 

^ CO F 2 

cd"^ Kb 

^ X O 
i2 CO CD *^ 

;^ « So 

^ 2 ~ CO 

tl CD 0) CD 
T3 CO CD S 

E.W: »— 
CO 



2 
13 

i 

CO 

i 

CO 

O 
CC 
Q 



CD 
CO 

O 

o 



o 
c 

CD 



0 0 
C7) ^ 

^ CO 
Q. CD 

11 . 
-ill 

£ "lo 

■D CL:^ 
:§ S-g 
^ >- *Z 
QL Q) ^ 
CO Ql <0 

"t; ^ 

CO CO X 
^ O P 
— o 

^ CD 
X 2 ^ 

1 5 g 




£-9- 

- <D C O 

B ^ 

C fll <1J CO 

CO 2 F JO 
^ J5 fet; o 
:5 :3 CO n ^ 

c ■= ^ c o 

• in < 
c CO. - 
CO -r- i2 
a.^ c 

P ?^ 

t: E 

CO ^ c " 

Q.-D D) <U TJ 

<D — 



■D 
C 
CO 
CO 

CD 

E 
jo 

< 



CO 

0) 

o 

I d: g" 

CO TJ 



CL 2^ 



c 

£ ^ :£ 

t: o .a 

CD .£ a> 
E S S 

br ro I— 

^ ^ o 

Z CO ^ 

< 2 ^ 

<D CL ^ U 

P S$ 5 cr 

> Ql <^ 

0 2 - -D 

Q. CO <i!' 0) 

CJ O *i 

CD ^ O -C 



CO $ 



<l> ^ c: 
Q. O ^ 

X " 



O 



-O " £ > 
7= CD CD CD 
r~ /— ^ k— 



CO ^ 

« o 



O ^ 
4-^ 



CD < h- ^ 



53 ^ C CD 
CO 

Q) ^ CO 



X ^ 



05 i£ t) 0) CD 
»- CD (;) (D 

C 
13 



CD 

E ^ 

13 0) CO 

(0 o) ^ 

CO €0 CO 

_ XI ^ 
o 



o 
"cO 

c 
o 



E 
o 

I 



CO 



> 

CO 

■D ^ 

c c 

^ CO 13 

_ .E o 

-n c CD g ^ 

5 5 J2 

♦5 *3 c: >» CO 

CO CD CO CD 
^ o Q- ^ 

05 ^ 
CD 



O 

»W O 

CO o CO ^ S 

S 5 S " 



2f 
S § §.1 ^- 

O O- c c^ — 
O D <1J o 

g -C -5 w 

^ CD O O 
CL CD O 
<p CO ^ 

"5 5^ ^ C 
2 CL5 z3 _ 

to o 
CD o 



CD C 
Q. CD 

o S- 

CD 
CD 

g 
> 

5 

CO 



c 
o 
o 

»- CO 

CD C 
CL O 



E 



"D JZ D) 
• • 0) O -t: — 
CO > iS 

^ i ^is 

O -55 ■§ ^ ^ 
Z 0) o 0) i= 



^ E o CO 
o CO c E 0) 

= -3 >^ 

CO O CD 9> 
C c C C-C 

<u ^ £ IT"*" 
E ^ ^ co" 

CL > E <D CO 

>^ CO 

*i 5 CD CD ^ 

- T3 3 
O CD o 

^cD S^l Y 
w 3 b S = 

O O) CO "J 

0 ^ CO ^ 0? 
CD W 00 CD £ 

c: :E <- 
2 H — — 

1 -Jo §-0 

CO ^ ^ 4= ^ 



£ .E 



c 

CO 



CD 

CL 



0 

O 
X 
0 



FIGURE 3.3 



DISTRIBUTION OF ESTIMATED FIVE-YEAR TOTAL GROSS COST 
PER AFDC-FG EXPERIMENTAL, BY AGENCY 



A. Distribution of Estimated Total Gross Cost 
per Experimental, by Agency 
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B. Percentage Distribution of Estimated Total 
Gross Cost per Experimental, by Agency 
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Butte, Riverside, San Diego, and Tulare than in Alameda and Los Angeles (5 to 6 percent), the two 
counties where participation in GAIN education and training activities lasted the longest, 

VI. Total Gross Cost per AFDC-FG Control (Figure 3,1. Box 7) 

Members of the control group did not have access to GAIN services but were free to enroll in 
community-provided education and training programs on their own initiative. Therefore, the cost per 
control includes expenditures by non-welfare agencies for these types of activities (Figure 3.1, box 
6).^^ The average cost of all such activities used by controls makes up the total gross cost per 
control As previously mentioned, it is that cost that serves as the benchmark against which the total 
gross cost per experimental must be compared in order to determine the net cost per experimental — 
i.e. , the increment in government dollars spent on employment-related activities per experimental, over 
and above what would have been spent on them in the absence of GAIN. 

Chapter 2 showed that many controls did, indeed, use non-GAIN employment-related services 
(see Table 2.4) and that their participation was concentrated in vocational training and post-secondary 
education programs. Because those activities were relatively expensive, the estimated total gross 
cost per control was substantial.^^ As shown in Table 3,5 (column B), it averaged $1,472 per control 
for the six counties combined (last panel), and only in Los Angeles was it less than $1,300, In the 
other five counties, the cost per control was quite consistent, varying at most by a few hundred dollars. 
Interestingly, vocational training or post-secondary education accounted for almost all of those costs. 



^^No data were collected on the receipt of support services by members of the control group in the course 
of their participation in employment-related activities, (Similarly, no data were collected on the use of such 
services by experimentals while participating in non-GAIN education and training activities,) While control 
group costs may have been underestimated because of the absence of data on their receipt of support services, 
the amount of that underestimation would probably be small. Although some public subsidies are available, 
many education and training providers do not offer support service payments. In addition, any underestimate 
of child care costs is likely to have been contained by the fact that most sample members had children no 
younger than age 6, 

■'^It should be noted that the costs incurred by the county welfare departments to process controls tlirough 
orientation and random assignment were considered to be costs that were incurred only for research purposes 
and thus were not counted as part of the cost of employment-related services received by controls. Hence, 
a zero is included in the category of "orientation, appraisal, and assessment" in Table 3,5, 

■'^Because the specific schools and agencies where controls took part in employment-related activities could 
not be determined in this analysis, unit costs for these activities were estimated in the following ways. For 
job search services, the cost of job search program operations (i,e,, excluding case management) for the 
experimental group in each county was also used as the job search unit cost for controls. This seems 
reasonable, especially since, in some counties, GAIN job search was provided by the conmiunity agency 
(HDD) that provides job search services for Unemployment Insurance (UI) recipients, who could have 
included controls. The welfare departments' unit costs for PREP and OJT were taken as the unit costs for 
unpaid work experience and OJT assignments (which were infrequently used activities) for controls. Finally, 
for ABE/GED, ESL, and vocational training and post-secondary education, the same community college, adult 
school, and ROC/P expenditure data that were used for confuting unit costs for experimentals were used for 
computing them for controls as well, but adjusted to reflect controls' relative frequency of using adult schools 
versus community colleges for basic education and for vocational training. 
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TABLE 3.5 

FOR AFDC-FG REGISTRANTS: ESTIMATED TOTAL GROSS COST PER EXPERIMENTAL. TOTAL 
GROSS COST PER CONTROL. AND NET COST PER EXPERIMENTAL WITHIN FIVE YEARS 
AFTER ORIENTATION, BY SERVICE COMPONE?^T 



Total Gross Cost Total Gross Cost Net Cost per 
County and per Experimental ($) per Control ($) Experimental (A-B) ($) 
Component W {B} (C) 

Alameda 



Orientation, appraisal, 



and assessment 


515 


0 


515 


Job search activities 


1183 


121 


1062 


ABE/GED 


1699 


80 


1620 


ESL 


149 


6 


143 


Vocational training or post- 








secondary education 


2250 


1172 


1078 


Unpaid work experience 


25 


1 


24 


OJT assignment 


0 


0 


-0 


Support services (a) 


1156 


0 


1156 


Total 


6977 


1379 


5597 



Butte 



Orientation, appraisal. 



and assessment 


627 


0 


627 


Job search activities 


570 


53 


517 


ABE/GED 


558 


77 


481 


ESL 


289 


31 


257 


Vocational training or post- 








secondary education 


1735 


1332 


403 


Unpaid work experience 


70 


8 


62 


OJT assignment 


5 


7 


-2 


Support services 


559 


0 


559 


Total 


4413 


1509 


2904 



L os Angeles ' 



Orientation, appraisal, 



and assessment 


520 


0 


520 


Job search activities 


589 


30 


559 


ABE/GED 


2083 


83 


2000 


ESL 


1033 


23 


1010 


Vocational training or post- 








secondary education 


1450 


477 


974 


Unpaid work experience 


0 


0 


0 


OJT assignment 


0 


0 


0 


Support services 


727 


0 


727 


Total 


6402 


613 


5789 



Riverside 



Orientation, appraisal, 



and assessment 


560 


0 


560 


Job search activities 


868 


21 


848 


ABE/GED 


464 


87 


378 


ESL 


174 


13 


161 


Vocational training or post- 








secondary education 


1223 


1744 


-520 


Unpaid work experience 


9 


5 


4 


OJT assignment 


3 


3 


0 


Support services 


168 


0 


168 


Total 


3469 


1871 


1597 



(continued) 



TABLE 3,5 (continued) 



Total Gross Cost 

County and per Experimental ($) 
Component (A) 


TT^tal C^Tr\cc ^^ot 
[Jet wUlUiUI ^9} 


Mot r^nQt npr 
pYrvarimpntal ^A — 

(C) 


wail Lyics4*>' 








Orientation, appraisal, 






326 


and assessment 


326 


0 


Job search activities 


698 


76 


622 


ABE/GED 


617 


99 


518 


ESL 


195 


30 


165 


Vocational training or post- 






-188 


secondary education 


1605 


17QP 


Unpaid work experience 


78 


c 
O 


79 


OJT assignment 


17 


A 




Support services (b) 


ooo 






Total 




9007 


1912 


HTt list ro 








Orientation, appraisal, 






383 


and assessment 


383 


0 


Job search activities 


484 


10 


474 


ABE/GED 


979 


62 


917 


ESL 


406 


69 


337 


Vocational training or post- 






178 


secondary education 


141 1 


\ ^oo 


Unpaid work experience 


19 


D 1 




OJT assignment 


b 




— 15 


Support services 




n 


502 


lotal 


*+ 1 053 


1455 


2734 


All coiintip** ICiS 








Orientation, appraisal, 






488 


and assessment 


488 


0 


Job search activities 


732 


52 


680 


ABE/GED 


1067 


81 


985 


ESL 


374 


29 


345 


Vocational training or post- 






321 


secondary education 


1612 


1292 


Unpaid work experience 


33 


13 


20 


OJT assignment 


5 


6 


-1 


Support services 


583 


0 


583 


Total 


4895 


1472 


3422 



SOURCE: See Table 3.1. 
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NOTES: The estimated unit cost of unpaid work experience per participant-month ranged from $80 in Alameda to $955 
in Tulare, and the OJT unit cost, which was estimated on a cost per participant basis, ranged from $6 in Alameda to $1 ,852 
in Tulare. However, these estimates are less reliable than those for the other activities owing to the very low use of unpaid 
work experience and OJT assignments. At the same time, the low use of these activities by experimental and controls 
means that, even with very high unit cost estimates (as in Tulare) , unpaid work experience and OJT assignments account 
for very little of the total gross cost per experimental and the tdtal gross cost per control. The same estimates were 
assumed to apply to controls participating in similar activities. 

Data on controls' use of support services were not collected . Although those costs are almost certain to be 
lower than the cost of GAIN support services for experimental, they are probably not zero (as was assumed for this 
evaluation). Similarly, data onexperimentals' receipt of non-GAlN support services while participating in non-GAlN 
activities (after leaving GAIN) were not collected and are probably not zero. 

The automated support service expenditure data that were available for Alameda and Los Angeles were not 
processed by MDRC in a way that would permit an average cost per monthly payment to be estimated. 

Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

(a) This figure includes a very small amount of transitional child care provided by GAIN under the three-month 
rule that applied prior to April 1990. 

(b) In San Diego, a very small amount of unlicensed in-home child care expenditures was included in the 
average cost per experimental estimate but excluded from the estimated average cost per monthly payment and average 
cost per person who received the service, owing to data limitations. 

(c) In the all-county averages, the results for each county are weighted equally. 
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VII. Net Cost per AFDC-FG Experimental (Figure 3,1. Box 5 Minus Box 7) 



Each county's net cost was calculated by subtracting the total gross cost per control from the 
total gross cost per experimental (or column B from column A in Table 3,5), These results, by type 
of activity and overall, are presented in colunm C of Table 3,5, As the last panel of that table shows, 
the estimated net cost per AFDC-FG experimental for all six counties was $3,422 (i,e, , $4,895 minus 
$1,472). (Rounding accounts for the numbers not adding up exactly,) As was found for total GAIN 
costs, Alameda and Los Angeles had the highest net cost per experimental - $5,597 and $5,789, 
respectively. Of the other four counties. Riverside had the lowest net cost ($1,597), followed closely 
by San Diego ($1,912), and then by Butte ($2,904) and Tulare ($2,734), 

Figure 3.4 presents these net cost estimates graphically by comparing the total gross cost per 
experimental and per control in each county using side-by-side bars for the two groups. It also 
distinguishes GAIN from non-GAIN costs for the experimental group and thereby helps to illustrate 
several important conclusions about the county variation in net costs. First, it can be seen from the 
small size of the shaded segment of each county's bar for experimentals that non-GAIN costs varied 
little across the six counties and, consequently, explain little of the variation in net costs. Rather, most 
of the variation in net costs was due to county differences in the total cost of GAIN per experimental 
(the white segment of the bar for experimentals) and the total gross cost per control. As previously 
noted, net costs were largest where GAIN costs were highest - in Los Angeles and Alameda. Also 
contributing to Los Angeles's high net cost was the relatively low cost per control in that county. 
Among the other counties, control group costs did vary by several hundred dollars, and so had some 
effect on the differences in net costs across those counties as well. Overall, net costs were lower to 
the extent that a lower GAIN cost per experimental was combined with a relatively high control group 
cost, as in Riverside and San Diego to a greater extent than in the other counties. 

Figure 3.5 presents a summary of the net cost estimate for each county, and shows the 
contribution of four broad categories of expenditures: (1) orientation, appraisal, and assessment, (2) 
job search, (3) all basic education (ABE/GED and ESL) and other post-secondary and vocational 
education and training (along with the very small amount of net costs for work experience and OJT 
costs), and (4) support services. The graph helps to illustrate that in Alameda and Los Angeles, the 
incremental investment of government dollars (i.e., the net cost) per experimental was allocated to 
education and training activities to a greater extent than in the other counties. At the opposite end of 
the spectrum, the graph illustrates that in Riverside there was almost no net government expenditure 
on education and training activities. In fact. Riverside produced a net increase in the use of basic 
education activities, but a reduction in expenditures for vocational training or post-secondary education 
(compared to what would have happened in the absence of GAIN, as measured by the control group's 
experience). 

VIII. Summary of Cost Estimates for AFDC-FG Registrants Determined Not to Need or to Need 
Basic Education 

Table 3.6 summarizes the cost findings for the AFDC-FG basic education subgroups. In most 
counties (all except Alameda and Butte), the net cost per experimental was higher for the subgroup 
determined to need basic education than for the subgroup determined not to need it. This difference 
was driven, of course, primarily by the experimental-control differences in the average number of 
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months spent participating in ABE/GED and ESL courses, and in job search activities. In Alameda, 
however, the net cost ($7,161) was more than $2,000 higher per experimental determined not to need 
basic education - and much higher than the net cost of serving that subgroup in any other county. 
The reason for that unusually high cost can be traced largely to Alameda's substantial impact on the 
rate and average duration of participation in GAIN vocational training and post-secondary education, 
in conjunction with its substantial impact on participation in job search activities. Among the other 
counties. Riverside and San Diego had the lowest net cost per experimental for those determined not 
to need basic education. These two counties had net costs that were at least $1,000 lower than the 
next lowest county (Tulare). 



IX. Summary of Cost Estimates for AFDC-U Registrants 

Gross and net costs were also estimated for AFDC-U registrants. Table 3.7 presents the 
findings on the total cost of GAIN per AFDC-U experimental (which can be compared with Table 3.2 
for AFDC-FGs). Table 3.8 presents the total gross cost per experimental, the total gross cost per 
controU^^ and the net cost per experimental (which can be compared to Table 3.5 for AFDC-FGs). 
Costs were not estimated for AFDC-Us in Alameda owing to the small size of the AFDC-U sample 
in that county. Across the other counties, the net cost per experimental ranged from $2,050 in San 
Diego to $4,449 in Los Angeles. In each county, with the exception of Los Angeles, the net cost per 
AFDC-U experimental was quite similar to the net cost per AFDC-FG experimental, with the 
difference being less than $600. In Los Angeles, the net cost per AFDC-U was $1,340 less than the 
net cost per AFDC-FG largely because of the much lower gross and net costs of ABE/GED instruction 
per AFDC-U compared to the corresponding costs for AFDC-FGs. 



ERLC 



As is true for AFDC-FGs, the total cost of GAIN per experimental accounted for most of the total gross 
cost per experimental: about 92 percent for the AFDC-U sample across the five counties combined. This 
can be seen by dividing the last entry in column E of Table 3.7 by the last entry in column A of Table 3,8. 
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TABLE 3.8 



FOR AFDC-U REGISTRANTS: ESTIMATED TOTAL GROSS COST PER EXPERIMENTAL. TOTAL 
GROSS COST PER CONTROL. AND NET COST PER EXPERIMENTAL WITHIN 
FIVE YEARS AFTER ORIENTATION. BY SERVICE COMPONENT 



County and 
Component 



Total Gross Cost 
per Experinriental ($) 
(AL 



Butte 

Orientation, appraisal. 

and assessment 
Job search activities 
ABE/GED 
ESL 

Vocational training or post- 
secondary education 

Unpaid work experience 

OJT assignment 

Support services 
Total . 



Los Angeles 

Orientation, appraisal, 

and assessment 
Job search activities 
ABE/GED 
ESL 

Vocational training or post- 
secondary education 

Unpaid work experience 

OJT assignment 

Support services 
Total 



Riverside 

Orientation, appraisal, 

and assessment 
Job search activities 
ABE/GED 
ESL 

Vocational training or post- 
secondary education 

Unpaid work expenence 

OJT assignment 

Support services 
Total 



Total Gross Cost 
per Control ($) 
(B) 



Net Cost per 
Experimental (A-B) ($) 



627 


0 


627 


612 


48 


564 


598 


73 


525 


529 


115 


414 


1312 


562 


750 


88 


9 


79 


0 


9 


-9 


278 


0 


278 


4043 


816 


3227 



520 


0 


520 


511 


12 


499 


668 


23 


645 


1823 


49 


1774 


899 


252 


647 


0 


0 


0 


0 


0 


0 


364 


0 


364 


4785 


336 


4449 



560 


0 


560 


1076 


25 


1051 


345 


56 


289 


377 


35 


342 


612 


872 


-260 


19 


5 


14 


0 


3 


-3 


157 


0 


157 


3146 


996 


2150 



San Diego 

Orientation, appraisal. 

and assessment 
Job search activities 
ABE/GED 
ESL 

Vocational training or post- 
secondary education 

Unpaid work experience 

OJT assignment 

Support services (a) 
Total 



326 


0 


326 


587 


57 


530 


716 


114 


602 


367 


67 


300 


768 


810 


-42 


94 


7 


87 


4 


5 


-0 


248 


0 


248 


3110 


1060 


2050 


(continued) 
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TABLE 3,8 (continued) 



Total Gross Cost Total G dss Cost Net Cost per 
County and per Experimental ($) per Control ($) Experimental (A-B) ($) 
Component (A) (B) | (C) 

Tulare 



Orientation, appraisal, 



and assessment 


383 


0 


383 


Job search activities 


430 


10 


421 


ABE/GED 


901 


56 


844 


ESL 


715 


144 


571 


Vocational training or post- 








secondary education 


1093 


888 


206 


Unpaid ViTork experience 


19 


38 


-19 


OJT assignment 


4 


13 


-9 


Support services 


314 


0 


314 


Total 


3859 


1148 


2710 



AH counties (b) 



Orientation, appraisal. 



and assessment 


483 


0 


483 


Job search activities 


643 


30 


613 


ABE/GED 


645 


65 


581 


ESL 


762 


82 


680 


Vocational training or post- 








secondary education 


937 


677 


260 


Unpaid work experience 


44 


12 


32 


OJT assignment 


2 


6 


-4 


Support services 


272 


0 


272 


Total 


3789 


871 


2917 



SOURCE: See Table 3.1. 



NOTES: The estimated unit cost of unpaid work experience per participant-month ranged from $80 in Alameda to $955 
in Tulare, and the OJT unit cost, which was estimated on a cost per participant basis, ranged from $6 in Alameda to $1 ,852 
in Tulare. However, these estimates are less reliable than those for the other activities owing to the very low use of unpaid 
work experience and OJT assignments. At the same time, the low use of these activities by experimental and controls 
means that, even with very high unit cost estimates (as in Tulare) , unpaid work experience and OJT assignments account 
for very little of the total gross cost per experimental and the total gross cost per control. The same estimates were 
assumed to apply to controls participating in similar activities. 

Data on controls' use of support services were not collected. Although those costs are almost certain to be 
lower than the cost of GAIN support services for experimental, they are probably not zero (as was assumed for this 
evaluation). Similarly, data on experimental' receipt of non-GAIN support services while participating In non-GAIN 
activities (after leaving GAIN) were nc': collected and are probably not zero. 

The automated support service expenditure data that were available for Alameda and Los Angeles were not 
processed by MDRC in a way that would permit an average cost per monthly payment to be estimated. 

The AFDC-U cost analysis does not include Alameda because of the small number of people in that county's 
AFDC-U sample. 

(a) In San Diego, a very small amount of unlicensed In-home child care expenditures was included in the 
average cost per experimental estimate but excluded from the estimated average cost per monthly payment and average 
cost per person who received the service, owing to data limitations. 

(b) In the all -county averages, the results for each county are weighted equally. 
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CHAPTER 4 

T^iTP^-WAP IMPACTS F QP STNGT.E-PARENT (AFDC-FG) REGISTRANTS 

TTie next three chapters present the effects, or impacts, of GAIN on employment and earmngs, 
AFDC receipt and payments. Food Stamp receipt and payments, and vanous "^f^j!^^" ^^^^.^^^^ 
family well being, and other outcomes. Chapter 4 J^^f^^f^^^^^ 
Unemployment Insurance (UI) records, AFDC payment records and f'^^^^^^'.^l 
re^eJch samole consists of AFDC-FG case heads who were classified as mandatory under pre-JOBS 
'r^ e" ^ srexfeptions, did not have a child under age 6).^ The analysis covers the fjrst 
ZZ year after each registrant attended a GAIN orientation. It includes summary measures for the 
e^ JeTee year follow up period; separate estimates for years 1, 2, and 3; and quarter-by-quarter 
e^^t^ Results are presented for the full sample, individual counties, and selected subgroups^ 
aSo^I re 'uU are shown in Appendix D. Quarter-by-quarter impact estimates through the end of 
vir 3 aTd through later quarters for early cohorts of program registrants are provided to indicate how 
Ee t^e irl^^ GAIN are likely to be in future years. The final section of the chapter presents 
SS-"^^^^ for AFDC-FGs who were newly mandatory -^er JOBS (i.e., had a chiW u^^^^^ 
Tge 6) mis analysis was based on a supplementary research sample, as descnbed m Chapter L 
Sa^er 5 analyzes outcomes based on survey data for AFDC-FGs. CMpter 6 gives impacts for 
AFDC-Us based on UI, AFDC, and Food Stamp records. 



I. 



A Snmm^rv Of th^ FinHin f s on E^ rnin p. and Welf-^re Savings for AFDC-FGs 



GAIN'S impacts on the earnings of AFDC-FGs continued to grow in the third year of foUow^upK 
Averaged across the six counties, with each county given equal weight, the earmngs impact was $266 
^^r exSi^eS during year 1.^ The impact nearly doubled, to $512, the following year and then 
o w t?SS6t year 3 for a three-year total of $1,414 per experimental group member.^ Average 
wdl e Sngs Lied off in year 3. After having grown from $283 to $347 ^^-^^^y^^^^^^^ 
2 thev were $331 in year 3, for a three-year total of $961 per experimental. The n^gmtude of 
GA?i?^s"J^gs impacts compares favorably with the three-year results for a group of previously 



tin Alameda, as discussed in Chapter 1, a substantial number of sample members had ^^^^^^ jm^^^^^^^^^ 
6 mLv ^these may not have been mandatory under the pre-JOBS rules but were mandatory under JOBS. 
Howe'rie dirai^^^^^^ in this study do not classify people into these two categones suff^c^ent 
Suracy to St^^.^rr ^ a^£Ur:g?6S" 

^'^'^^^^li^'o^ll^s 1 and 2 may differ slightly from those presented in the two-year (1993) impact 
renort owing to updating of some earnings and AFDC records data. , , „ ,„^c onH 

' ^Xuglout the impact analysis, rounding may cause slight discrepancies m calculating sums and 



differences. 
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studied demonstration programs, and die AFDC impacts compare very favorably.^ All of these GAIN 
raipacts were statistically significant.^ oi mese oaiin 

• ^"Ss;"^Pacts grew in four of the sk counties from year 2 to year 3. The largest impacts 
were m Riverside: $3 1 13 per experimental($920 in year 1, $1,183 in year 2, and $1,010 in yTs 
or 49 percent above die control group average. This dollar figure is about twice die size of die largesi 
diree-year impact previously estimated in an experimental evaluation of a broadly targeted welfare-to- 
work program. One reason die tiiree-year earnings impact in Riverside was so large is diat die 
expenmental-control difference persisted flirough year 3 of follow-up. Anodier reason is diat earnings 
gains in Riverside were produced consistently across subgroups. Alamed2, Butte, and San Diego had 
middle-tevel diree-year earnings impacts: $1,474 to $1,772 per experimental, or 21 to 30 i^rcent 
above die control group average. Also of note was die $513 increase from year 2 to year 3 in die 
earnings impact for Tulare, where positive and statistically significant effects were observed for die 

T,',ilrr%. ^? ' ^'^^^'^ °^ ^^^^ ^"^P^^i^ GED preparation in 

Tulare. The part of die sample diat had been deemed to need basic education showed an earnings 
impact of nearly $700 in Tulare in year 3, an amount diat is in die middle range for year 3 for die in- 

ttw r' ^^"^"y' Los Angeles, earnings impacts contnued 
to grow slightly more positive over time - from a small loss in year 1 to small gains in years 2 and 
3 - but for die entire diree-year period diey remained small and not statistically significant. 

The pattern of welfare savings was somewhat different. As was true of earlier results die 
argest diree-year impacts were in Riverside: a $1,983 reduction in AFDC payments (15 percent of 
die control group average payment), split about equally among die diree years. These dollar savings 
were greater dian die largest diree-year AFDC impacts previously found in MDRC's experimenmi 
evaluations of broadly targeted welfare-to-work programs. Alameda, Butte, Los Angeles and San 
Diego form a middle tier, widi total AFDC savings over die diree years ranging from $782 to $1 136 



f .V, , "k?"""' °? 7 welfare-to-work demonstration programs diat, like GAIN, aimed for broad coverage 
of die eligible caseload all showed increased eanungs impacts from year 1 to year 2, and two showed fiirther 
mcreases m earnings mipacts for year 3. Three of die five programs showed increased welfare savings from 
year 1 to ye^ 2, and two showed increases from year 2 to year 3. Earnings impacts tended to peak in year 
L""^^, r T""^' '° ^ ^ 2- ^ ™^ °f ^es"lts, see Friedlander 

Smp^^on ^ (^991). Section III of diis chapter expands upon tiiis 

The term broad-coverage denotes a program diat aims to reach everyone in a particular target group (e g 
a^I smgle parents with children older dian a specified age). Broad-coverage programs contrast witii approache; 
diat sdect out from die target group only certain individuals to work witii, widi selection criteria usually based 
on subjective assessments of abUity and motivation. Broad-coverage programs have, in die past, been large- 
scale or suitebk for large-scale implementation, have mosdy been mandatory, and have combined several 
activities and admmistrative procedures in a complete welfare-to-work "system. " Selective or, more formally 
selective-voluntary programs have been tested experimentally only as single activities diat .are pieces of 
toger systems, only at small scale, and, as die name implies, only widi voluntary participation. Comparisons 
of impact results across die two categories are hazardous, and diis report's contextiial frame for GAIN 
includes previous findings for broad-coverage programs only. See Gueron and Pauly (1991) for a fiiller 
discussion of die distinction between broad-coverage and selective-voluntary programs 

Statistical tests were applied to estimates of program impacts to assess die likelihood that diese estimates 
could, by chance, show an impact when diere really was none. An estimate diat is "statistically significant- 
implies a high de„ .e of confidence that die impact is a real program effect and not die result of chance. 
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or 4 to 8 percept of the control group average. Welfare savings grew larger in year 3 in Alameda, 
but declined somewhat in Butte, Los Angeles, and San Diego. Small welfare savings were found for 
the first time in Tulare in year 3, but these were not statistically significant. 

In Los Angeles, the magnitude of employment impacts would lead one to expect larger earnings 
impacts than were actually observed. In addition, AFDC savings were larger than earnings impacts. 
This pattern of results suggests that the GAIN program in Los Angeles helped some sample members 
find jobs, but that much of this measured employment was short-term or intermittent, part-time, or at 
hourly wages lower than those obtained by employed controls. That is, the measured employment 
obtained by some experimentals with the help of GAIN paid less than employment obtained by 
controls, and this reduced total earnings gains. The initial employment, however, was enough to close 
AFDC cases or to reduce grants. In addition, it appears that some sample members either left AFDC 
without getting a job or got a job, left it, but did not return to AFDC. Thus, there was a small 
increase (relative to the control group) in the percentage of experimentals in Los Angeles who had 
neither earnings nor AFDC payments, which also contributed to th? high ratio of AFDC impacts to 
earnings impacts. 

This chapter also addresses the question of whether there were earrangs gains and welfare 
savings for certain subgroups. One subgroup of particular interest is registrants who were determined 
by GAIN to need basic education, since providing basic education to this group is an important aspect 
of GAIN and accounts for a large portion of program expenditures. The analysis found three-year 
impacts on earnings and AFDC payments for both the "in need" and "not in need" subgroups. In three 
counties - Alameda, Riverside, and San Diego - three-year earnings gains were larger for those not 
in need, whereas the opposite was true for Butte and Tulare. In Los Angeles, three-year earnings 
impacts' were larger for those not in need, although neither subgroup showed statistically significant 
effects. Across the six counties, the differences between the two education subgroups in terms of 
welfare savings did not follow a consistent pattern. 

Longer-term AFDC recipients, another key subgroup, experienced both earnings gains and 
welfare savings. No definite pattern was found of these impacts being larger or smaller than those for 
welfare applicants or short-term recipients. Across racial and ethnic groups, the largest impacts were 
found among whites and blacks. The relatively large earnings impact for black sample members in 
Alameda is especially significant because that sample was drawn from a long-term AFDC population 
in a major inner-city area (Oakland). The least evidence of impacts from GAIN was found for the 
Asian/other subgroup. 

Another important subgroup consists of "new JOBS mandatories," i.e., AFDC-FG case heads 
who, when GAIN became JOBS, were newly classified as mandatory because they had a child under 
age 6. Prior to JOBS, such persons were exempted from GAIN'S participation mandate. A sample 
of new JOBS mandatories was available in three counties.^ Analysis of this sample suggests that 
program strategies that produce impacts for other groups can also produce impacts for the new JOBS 
mandatory group. 



^In Alameda, the sample was a subsample of the research sample and did not distinguish between pre- 
JOBS mandatories with a child under age 6 and new JOBS mandatories with a child under age 6. (See Chapter 
1.) 
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An important question is whether the variation in GAIN'S impacts across cour;-t:?s is simply a 
by-product of the different mix of demographic characteristics in each county, or persist when these 
factors are held constant. This issue is explored in Chapter 8. However, in advance of that chapter, 
it should be noted tliat the overall pattern of county differences in impacts appears not to be explained 
simply by differences in the background characteristics of their GAIN research samples. County 
differences are more likely to reflect such factors as the effects of different strategies for implementing 
GAIN and the influence of different local environments. 

The three-year impact estimates presented in this chapter do not capture all the impacts of 
GAIN. Patterns for the first three years indicate that experimental-control differences in earnings and 
AFDC payments may be expected to continue into year 4 and perhaps beyond. Indeed, analysis of 
extended follow-up data available for a group of early GAIN sample entrants suggests that impacts 
will, by and large, continue. 



II. Methodological Issues 

The GAIN impact analysis asks two fundamental questions. First, "What were the rates of 
employment, AFDC receipt, and Food Stamp receipt and the average earnings, AFDC payments, and 
Food Stamp payments for individuals registered in GAIN?" This question is readily answered by 
observing the behavior of any representative sample of individuals eligible for GAIN'S services and 
subject to GAIN'S participation requirements. In tihiis study, the experimental group provides estimates 
of outcomes for individuals in GAIN. The second question is, "How different would the outcomes 
have been if there had been no GAIN program?" This question is much more difficult to answer 
because the behavior of GAIN registrants cannot be observed in the absence of GAIN. 

It is possible, however, to observe the behavior of control groups that did not differ 
systematically from experimental except that they were not eligible for GAIN. For each GAIN 
county, the differences between average outcomes for the experimental group and average outcomes 
for the control group provide estimates of GAIN'S impacts for the county. For, as long as the controls 
remain ineligible for GAIN, the experimental-control comparison yields a valid estimate of the 
program's impact. In the GAIN evaluation, controls were not eligible for GAIN for three years, 
beginning with the date of an individual's random assignment to the experimental or control group; 
in the subsequent two years, the counties were not to recruit or give special preference to serving 
controls. The three-year follow-up analyzed in this report falls within this five-year period. 

The calculated differences in average outcomes between experimental and controls may be 
subject to some uncertainty because various random factors might make those differences slightly 
positive or slightly negative even if there were no real differences caused by the program. To nile 
out the effect of chance, outcome differences between experimental and controls were tested statis- 
tically. In the present analysis, outcome differences were considered statistically significant if there 
were no more than a 10 percent probability that the measured differences could have been produced 
by chance and not as a result of GAIN. 

The random assignment research design constitutes a simple yet powerful solution to the 
problem of estimating program impacts in an unbiased manner. To follow the experimental design 
faithfully, however, requires that comparisons between experimentals and controls closely adhere to 
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certain protocols. In particular, all persons randomly assigned must be included in the impact 
calculations in order for the resulting impact estimates to be unbiased. This means, first, that all 
controls must be compared with all experimentals. Both GAIN nonparticipants and participants must 
be retained in the experimental samples. This, in turn, implies that impact estimates must be reported 
as impacts "per experimental" and not, as is often the case with other kinds of evaluations, as impacts 
"per participant." The "per-experimental" basis is especially suited for studying mandatory programs 
such as GAIN. The very existence of a requirement to participate may itself produce effects, perhaps 
prompting some program registrants to avoid having to participate by finding a job on their own or 
by leaving welfare. In addition, those nonparticipants who did not comply with program requirements 
may have been sanctioned with an AFDC grant reduction, which represents a real reduction in AFDC 
payments. Such effects, which would be part of the true impact of the program, would not be 
captured by impact estimates calculated for participants only. They can be counted correctly only if 
nonparticipants are included in the calculations along with GAIN participants. 

Including all research sample members in the impact calculations means that estimates of 
average earnings and average AFDC and Food Stamp payments must be interpreted carefully. It 
means, for example, that estimates of average earnings per experimental necessarily will include zero 
dollar amounts for sample members who were not employed during the period involved. Similarly, 
estimates of average AFDC and Food Stamp payments will include zero dollar amounts for sample 
members who did not receive benefits during the period in question. To the extent that the program 
converts noneamers to earners, or encourages welfare recipients to leave welfare, excluding sample 
members with zero dollar values from the experimental and control averages would obviously lead to 
a serious underestimation of program impacts. 

The experimental group includes only those persons who attended a GAIN orientation and were 
randomly assigned. The per-experimental basis for impacts therefore does not capture possible impacts 
on individuals who were referred to GAIN but never showed up for an orientation. Some of these 
individuals may have been sanctioned, while others may have left welfare or found a job specifically 
to avoid GAIN. Because these individuals were not included in the research samples for the current 
study, any impacts they might have felt will not be counted. The three-year impact estimates presented 
in this report may therefore slightly underestimate the full impact of GAIN. 

The discussion of impacts in the various sections of this chapter will often begin with mention 
of the outcome levels for controls rather than experimentals. The behavior of controls indicates what 
would have happened without GAIN. Their behavior indicates whether the sample GAIN worked with 
would have performed well or poorly in the absence of GAIN. Control group outcomes can also be 
compared across counties. Such comparisons can tell whether certain counties worked vith registrants 
that were or were not relatively "job-ready" or "dependent." Similar comparisons across subgroups 
can identify particular subgroups that are likely to exhibit one or another kind of behavior in the 
absence of GAIN. 

Random assignment at GAIN orientation presenls difficulties for comparing impact estimates 
for GAIN with those for other program evaluations where the point of random assignment was located 
at a different stage of the intake process. In particular, for evaluations in which random assignment 
was performed at the point where individuals were first refened to the welfare-to-work program, the 
research sample may represent a larger share of the eligible caseload than in studies that place it at the 
later stage, which some referred individuals do not reach (e.g., because they leave welfare in the 
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meantime). In addition, certain aspects of random assignment at referral may tend to raise, and others 
to reduce, the amount of program impact accruing to the research sample. On the one hand, the 
impact estimates in such designs will capture any effects - e.g., from sanctions - occurring between 
referral and orientation. On the other hand, impact estimates will be diluted by the presence in the 
sample of some welfare applicants who turn out to be ineligible for AFDC, whose applications are 
never approved, and who therefore are not obliged to show up at orientation. These applicants 
experience no impact from the welfare-to-work program, since they would have been ineligible for 
AFDC even without the program. 

Within GAIN, differences in targeting complicate comparisons across counties. T?^.rgeting 
differences create differences in the characteristics of sample members across counties. In addition, 
in counties with narrow targeting plans, GAIN registrants (and the research samples) will represent 
a smaller share of the overall AFDC caseload than in counties that target more broadly. For example, 
in Alameda and Los Angeles, which served only long-term AFDC recipients, the research samples will 
include, on average, individuals with greater skills deficits and employment barriers than elsewhere. 
The impact estimates in these two counties may not apply to other portions of their caseload. 

Six main kinds of outcomes are examined in this chapter: employment, earnings, receipt of 
AFDC (e.g., percentage receiving any AFDC in a quarter), amount of AFDC payments, receipt of 
Food Stamps, and amount of Food Stamp payments. Earnings have greater variability across sample 
members than do the other outcomes. Impact estimates for earnings will therefore generally be less 
precise than impact estimates for the other measures. This means, e.g., that a given estimate of an 
employment impact may be statistically significant, while its associated estimate of earnings impact is 
not. In such cases, the employment result increases confidence that there is, in fact, an earnings 
impact. 

Sample sizes available for subgroup analysis pose another problem. Subgroups are, by 
definition, smaller than the full research sample. Reduced sample sizes decrease the precision of an 
impact estimate. This means that a particular impact value that was statistically significant in a full- 
county sample may no longer be statistically significant if it appears as the impact estimate for only 
a subgroup of the county sample. By the same token, a particular numerical impact estimate for a 
subgroup generally has a wider range of uncertainty around it than a full-sample estimate. Thus, the 
magnitude of the subgroup estimates should be interpreted with particular caution. In the subgroup 
tables, impact estimates derived from very small samples are flagged to indicate low reliability.^ It 
should be added, however, that comparisons of means (averages) across subgroups or across counties 
are less affected by sample size and can often provide useful information when samples are too small 
to permit reliable estimation of impacts. 



^As it relates to statistical precision, the effective "size" of an impact sample depends in a complex way 
on the number of experimentals and controls and variation in the outcome measure. In classifying subgroups 
by sample size, the size of an "equivalent control group size for balanced designs" was calculated, which lies 
between the sizes of the experimental and control groups but is generally less than the average of the sizes 
of both. Then the standard errors for the summary earnings gains and welfare reductions were examined to 
determine which equivalent control group sizes yielded quite imprecise estimates. As a result of this 
examination, subsamples with an equivalent control group size of 100 or less were designated "unreliable"; 
from 101 up to 250, the subsamples were singled out as being of reduced reliability relative to the other esti- 
mates. 
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An additional set of analysis issues concerns the organization of the follow-up data on earnings, 
AFDC, and Food Stamps and the length of the follow-up period. UI earaings data are maintained by 
calendar quarter periods: January through March, April through June, etc. But sample members were 
randomly assigned daily. Consequently, the earnings reported for any sample member's "quarter 1," 
which includes the date of random assignment, will often include some earnings that preceded that 
person's random assignment. Such pre-program earnings cannot logically be part of die GAIN 
program's impact. For that reason, quarter 1 is not counted in die summary measures of program 
impacts presented in this chapter and the next. Thus, for example, follow-up "year 1" will be defined 
as quarters 2 through 5. 

AFDC payments data were available mondily. In order to exactly match the intervals covered 
by earnings data, AFDC payments wre regrouped. This means that for someone randomly assigned 
in February, quarter 2 is April through June for bodi earnings and welfare. It also means that year 
1 of welfare follow-up is composed of the 12 mondis from April through March of the subsequent 
year. This convention implies diat any impact on employment or earnings in, say, quarter 3 pertains 
to exactly the same time period as an impact on welfare in quarter 3. As with earnings, die quarter 
of random assignment is dropped from summary welfare measures. Food Stamp data were available 
monthly and are organized die same way as AFDC data are organized for diis report. 

UI earnings data are maintained by the State of California statewide. AFDC and Food Stamp 
payments are maintained separately by each county. If a sample member moves out of a county, 
AFDC and Food Stamp payments will appear to go to zero in the evaluation data file, even if die 
individual returns to welfare in a different county in die state. Earnings data will continue, however, 
unless the individual leaves the state. For cross-state migrants, earnings, AFDC, and Food Stamps 
will all appear to go to zero in the evaluation data. There is, however, no expectation that such effects 
should differ systematicaPy between experimental and control groups. Thus, even diough average 
earnings and average ArDC and Food Stamp payments may be somewhat underestimated for 
experimental and control groups, die differences between those averages should not be much affected. 
Any biases in impacts should be small. ^ 

Earnings, AFDC, and Food Stamp payments data are available in all counties at least dirough 
quarter 13. This is die "common" period of follow-up. In Butte, Los Angeles, and Riverside, one 
additional quarter is available for earnings and two for AFDC and Food Stamps; in San Diego, data 
on earnings and AFDC and Food Stamps are available dirough quarter 16. For die full sample in each 
county, quarterly earnings and AFDC payments have been computed and are shown (in Appendix D) 
for as many quarters as are available. Tlie discussion in diis chapter will, however, focus on die 
common follow-up: "year 1," "year 2," and "year 3" (quarters 2 dirough 5, 6 dirough 9, and 10 
through 13, respectively). 

Finally, some discussion of die expected mechanism of program impact is in order. As typically 
portrayed, welfare-to-work programs have dieir initial impacts on employment and earnings, and diose 
impacts lead in turn to reductions in welfare. In practice, die relationship between earnings gains and 
welfare reductions is far from clear-cut. In some past programs, large earnings gains have been found 
widiout welfare reductions. This may come about for several reasons. There may be errors in reports 



^Earnings not covered by or not reported to the UI system may also result in minor biases of earnings 
impacts toward zero. 
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of earnings or administrative lags in AFDC case closure following the start of employment. Earnings 
gains may accrue mostly to short-term welfare recipients who would have been off public assistance 
quickly anyway. Or earnings gains n*^y be concentrated among individuals for whom the gains are 
larger than the amounts needed to close welfare cases. In addition, work expense and child care 
allowances provided for AFDC recipients may offset any increase in earnings, thus allowing those 
recipients to remain on welfare while working. 

Conversely, some welfare reductions have been observed without corresponding earnings gains. 
Again there may be several contributing factors. Sanctions may produce some welfare impacts without 
any effect on employment. Contact between welfare-to-work program staff and program registrants 
may speed the process of case closure for individuals who find work, even if they would have found 
those same jobs without the program's help. There may also be "deterrent effects" for individuals who 
leave AFDC to avoid having to participate in the welfare-to-work program but who do not take jobs, 
or who may be working at ''under the table" jobs not captured by the administrative records data. In 
some programs, there may be a real increase in job-finding that leads to an increase in case closure, 
but the jobs may not last very long and individuals may not return to AFDC right away. 



III. A Context for Understanding GAIN^s Thrc*v Year AFDC-FG Imparts 

For analytical purposes, GAIN may be seen as two programs in one, corresponding to the two 
tracks for GAIN registrants: one for registrants determined not to need basic education and one for 
those deemed to need it. From this perspective, it becomes natural to seek to compare the impact 
findings for AFDC-FGs in the two GAIN tracks with findings for single-parent registrants in two kinds 
of broad-coverage welfare-to-work programs evaluated with experimental designs during the 1980s. 
The first kind comprises low-cost programs consisting primarily of job search activities but often 
including a work experience activity as well. A second kind of program used job search and work 
experience but also incorporated some education and training and operated at higher cost. MDRC 
conducted seven experimental studies of the first kind of program and two of the second kind (see 
Appendix Table D.l).^ Comparisons across these earlier programs - and between GAIN and tliese 
programs - must be made and interpreted with caution because the programs differed in goals, 
services, degree of enforcement, and local conditions. 

Among the low-cost programs, the median three-year earnings impact was about $700 per 
experimental sample member during the mid- 1980s. The median inree-year AFDC reduction was 
about $200 per sample member. These programs were generally found to be cost-effective. However, 



^he seven low-cost programs were the two Louisville WIN Laboratory Experiments, the Arkansas 
WORK Program, the Cook County (Chicago) WIN Demonstration program, the West Virginia Community 
Work Experience Program (CWEP), the Virginia Employment Services Program (ESP), and the San Diego 
Employment Preparation Program/Experimental Work Experience Program (EPP/EWEP). The two programs 
with some education and training were Baltimore Options and the San Diego Saturation Work Initiative Model 
(SWIM). The experimentally evaluated small-scale programs, such as those in Maine and New Jersey, are 
not directiy comparable to broad-coverage programs such as the nine i;.sted and GAIN. Not only were they 
small, but they were also voluntary and registered individuals selectively. See Gueron and Pauly, 1991. 

^^See Friedlander and Gueron, 1992; Gueron and Pauly, 1991. 

^ impact estimates for earlier programs are not inflated to current dollars. 

-112- 

erJc -''I 'J 



although the programs increased employment and earnings, the pay rates of employed members of the 
experimental group were typically no greater than those for employed control group sample members 
and were not sufficient by themselves to lift inany families out of poverty. Moreover, earnings gains 
were not found consistently for the most disadvantaged groups, including long-term AFDC recipients. 

The SWIM demonstration in San Diego in the late 1980s illustrates another kind of program, 
a moderate-cost intervention that, again, began with job search followed by work experience. But 
SWIM assigned other activities, including education and training, to registrants who did not obtain 
employment during their initial activities. In addition, registrants could find and enroll in education 
and training on their own and, if SWIM approved, could participate in those activities as substimtes 
for the regular SWIM activities. During the first three years of follow-up, San Diego SWIM produced 
total earnings gains of $1,551 per experimental sample member, $352 in year 1, $644 in year 2, and 
$555 in year 3. It should be noted that San Diego SWIM, which was among the most mandatory and 
heavily sanctioning of the nine comparison programs, achieved the largest welfare savings among 
them, a three-year total savings of $1,462 ($419 per experimental in year 1, $560 in year 2, and $483 
in year 3).^^ 

In its emphasis on upfront job search, each of these programs bears some similarity to the job- 
search-first track of GAIN, which is intended for individuals determined not to need basic education. 
For the education-first track in GAIN, there are no completed experimental studies of similar 
programs. The moderate-cost Baltimore Options program, however, differed from the others in 
providing some education or training as an alternative first assignment to job search and work 
experience. Although GAIN does not permit the same degree of choice, its basic education track has 
in common with the Baltimore program a significant emphasis on human capital development, which 
may be expected to take longer to show impacts but which, it is hoped, may produce larger impacts 
in the long run. Baltimore produced an earnings impact of $140 per expenmental sample member in 
year 1. This gain nearly tripled, to $401, in year 2. It further increased to $511 in year 3, held up 
at about that level through year 5, and appeared likely to persist even beyond that point. However, 
Baltimore, which permitted some registrant choice of activity and did not sanction much, achieved no 
welfare reductions. 



rv. Three- Year Impacts for the Pooled (Six-Countv) Sample and t he Individual Counties 

Figure 4.1 presents the trends in average quarterly earnings and average quarterly AFDC 
payments for the experimental and control group samples in each of the six GAIN study counties. 
These quarterly estimates and other impact estimates for the counties' AFDC-FG samples are shown 
in detail in Appendix Tables D.2 through D.7. It will be noted that some counties have more than the 
basic 13 quarters of follow-up: Butte, Los Angeles, and Riverside have 14 quarters of earnings and 
15 quarters of AFDC payments, and San Diego has 16 quarters of earnings and AFDC payments. 

A. The Behavior of Controls 

The control groups provide benchmarks for the earnings and welfare receipt the research sample 
would have experienced without GAIN. It is clear from Figure 4.1 that, even without Uie assistance 



i^See Friedlander and HamUton, 1993. 

^^Gueron and Pauly, 1991; Friedlander and Burtless, forthcoming. 
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of GAIN, many controls were active in the labor force. Average earnings for controls increased 
steadily after the point of random assignment, indicating an increase in job-holding over time, although 
in three counties average earnings declined slightly at the end of year 3, 



A comparison of employment rates for contro^r. in the individual counties illustrates their labor 
market activity and the differences in the make-up of program samples from county to county. Control 
group employment rates at the end of year 3 (i.e., in quarter 13) were as follows: 

Alameda 18,8 percent employed 

Butte 29,6 '| 

Los Angeles 16,8 

Riverside 24,6 

San Diego 28,0 " 

Tulare 26,6 

These rates are somewhat below those found in some other studies, About one-quarter of the 
controls in Butte, Riverside, San Diego, and Tulare were employed at the end of year 3, Controls in 
Alameda and Los Angeles worked at about two-thirds the rate of those in the other four counties. 
Although control employment rates are partly influenced by labor market conditions, the much lower 
rates in Alameda and Los Angeles compared to the other four counties reflect important differences 
in the types of people in the counties' samples. As noted in Chapter 1, Alameda and Los Angeles 
worked only with long-term AFDC recipients, a group characterized not only by a long history of 
reliance on AFDC but also by lower rates of recent work experience and lower high school completion 
rates. Consequently, the control samples in Alameda and Los Angeles quite naturally evidenced lower 
rates of employment during the follow-up period. 

Analogous patterns can be seen for controls with regard to AFDC receipt. The figures show 
declining AFDC payments after random assignment as more and more controls left welfare. These 
case closures illustrate the normal process of welfare dynamics, with individuals leaving AFDC 
because they become married or reconciled, find jobs on their own (perhaps by participating in non- 
GAIN programs), or lose eligibility because their children "age out" of AFDC, Welfare receipt rates 
for controls show patterns mirroring the employment patterns in the six counties. In quarter 1 of 
follow-up, almost all controls received AFDC. By quarter 13, control group AFDC receipt rates had 
declined to the following levels: 

70.6 percent received AFDC 



Alameda 


70.6 


Butte 


41.0 


hos Angeles 


67.5 


Riverside 


45.8 


San Diego 


51.9 


Tulare 


56.2 



^'^Employment rates for quarter 13 are not available in many other studies. In San Diego SWIM, quarter 
13 employment among AFDC-FG control group sample members was 28.6 percent; in Baltimore Options, 
quarter 12 employment was 40.3 percent; m Arkansas WORK, quarter 12 employment was 18.3 percent; and 
in Virginia ESP, quarter 10 employment was 34. 1 percent. 
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Fairly rapid departure from welfare is common in the AFDC population, and iias been noted for 
samples in other studies of welfare-to-work programs. Less than half of the control groups in Butte 
and Riverside and less than 60 percent of controls in San Diego and Tulare were on AFDC at the end 
of year 3. In Alameda and Los Angeles, however, approximately 7 of 10 controls were still on 
welfare at that point. Again, these differences reflect the longer welfare histories of the Alameda and 
Los Angeles samples. 

B. Tm pacts on Employment, Earnings. AFDC Receipt, and AFDC Payments 

The differences between experimentals and controls presented in Figure 4. 1 are the estimates 
of gain's impacts on earnings and AFDC payments. These and other nxmierical estimates of program 
impacts are also shown in Table 4.1 (and Appendix Tables D.2 through D.7). This table shows year- 
by-year and summary estimates for the first three years of follow-up (quarters 2 through 13).^^ 
Estimates for the third year can indicate whether any impacts should be expected from later follow-up. 
In prior experimental studies, however, earnings impacts in year 3 were not always good predictors 
of impacts in later years. Estimates of employment rates for the last quarter of year 3 (i.e., quarter 
13) are presented to indicate how much lower employment is at a point in time compared to any 
employment over the whole year. Estimates of AFDC receipt rates are shown for the end of each year 
(i.e., quarters 5, 9, and 13) because these point-in-time rates are more indicative of behavior and 
impacts than are measures of ever receiving any AFDC over a whole year. 

The largest impacts were found in Riverside, and all the impacts for that county were 
statistically significant.^^ In Riverside, 53.4 percent of controls worked at some time during the first 
three follow-up years compared to 67.1 percent of experimentals, for a difference, or impact, of 13.6 
percentage points. The year 1 impact was 18.0 percentage points, declining in year 2 to 14.0 
percentage points, and furtlier declining to 9.3 percentage points in year 3. The employment rate 
impact was still strong at the end of year 3: In quarter 13, 31.2 percent of experimentals were 
employed compared to 24.6 percent of controls, a gain of 6.6 percentage points. The three-year 
earnings gains totaled $3,113 ($920 in year 1, $1,183 in year 2, and $1,010 in year 3). 

AFDC impacts in Riverside were correspondingly large. The average number of months on 
AFDC during the first three years was 20.66 for controls and 18.54 for experimentals (see Appendix 
Table D.5). Reductions in welfare receipt of about 4 percentage points occurred as early as quarter 
3 and were sustained above that level during each succeeding quarter. AFDC payments during the 



^^In San Diego SWIM, 48.3 percent of the AFDC-FG controls were on AFDC in quarter 13; in Baltimore 
Options, 48.4 percent in quarter 12; in Arkansas WORK, 40.1 percent in quarter 12; and in Virginia ESP, 
39.3 percent in quarter 11. 

^^As noted earlier, quarter 1 (the quarter of random assignment) is omitted in the summary measures 
because, for some sample members, diat quarter may have included earnings and AFDC payments that 
preceded the day on which random assignment took place. 

^^The importance of having actual data beyond year 3 is illustrated by comparing San Diego SWIM and 
Baltimore Options. Both had relatively large earnings impacts in year 3. In San Diego SWIM, earnings 
impacts declined after year 3. In contrast, in Baltimore Options, earnings impacts in year 5 were almost as 
large as the peak in year 3. See Friedlander and Burtless, forthcoming. 

^^Variation in impacts across counties for AFDC-FGs was statistically significant at the 1 percent level 
for total three-year earnings and total three-year AFDC payments. 
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TABLE 4.1 

GAIN'S THREE-YEAR IMPACTS ON EMPLOYMENT. EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS FOR AFDC-FG REGISTRANTS 



Experimentals 



County and Outcome 

Alameda 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1205) 



Controls 



Difference 



Butte 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1-3) 

Average total earnings ($) 
Yearl 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yearl 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1229) 



30.1 
32.8 
33.9 
24.8 
48.8 



1421 
2132 
2880 
6432 



86.0 
76.6 
67.5 



6916 
5816 
4861 
17593 



602 



42.3 
46.3 
46.7 
32.9 
63.4 



2001 
2998 
3638 
8637 



65.0 
49.4 
39.7 

5132 
3715 
2812 
11659 

986 



27.3 
26.3 
26.7 
18.8 
40.8 



1212 
1624 
2105 
4941 



89.2 
77.1 
70.6 



7066 
6077 
5232 
18375 

603 



45.6 
42.2 
42.5 
29.6 
03.7 



1729 
2442 
2992 
7163 



68.4 
47.7 
41.0 



5486 
4048 
3101 
12635 

243 



2.8 

6.5 *** 
y 2 *** 

6.0 *** 
8.0 *** 



. 209 
508 * 
774 ** 

1492 ** 



-3.2 
-0.5 
-3.1 



-150 
-261 
-371 ** 
-782 * 



-3.3 
4.0 
4.3 
3.3 

-0.2 



272 
556 
647 
1474 



-3.4 
1.7 
-1.3 



-353 
-333 
-290 
-976 



Percentage 
Change 



10.1% 
24.8% 
26.9% 
32.0% 
19.5% 



17.3% 
31 .3% 
36.8% 
30.2% 



-3.6% 
-0.7% 
-4.4% 



-2.1% 
-4.3% 
-7.1% 
-4.3% 



-7.2% 
9.6% 
10.1% 
11.0% 

-0.4% 



15.7% 
22.8% 
21 .6% 
20.6% 



-5.0% 
3.6% 
-3.2% 



-6.4% 
-8.2% 
-9.3% 
-7.7% 



(continued) 
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TABLE 4.1 (continued) 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Los Angeles 

Ever employed (%) 
Yean 
Year 2 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 4396) 



Riverside 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Year 1 
Year 2 
Years 

Total (years 1 -3) 
Sample size (total = 5508) 



27.0 
26.9 
26.0 
19.3 
39.4 



1304 
1699 
1939 
4943 



84.8 
74.0 
63.8 



6874 
5711 
4729 
17314 

2995 



52.1 
49.4 
44.5 
31.2 
67.1 



2470 
3416 
3562 
9448 



58.7 
46.6 
40.6 



4962 
3458 
2864 
11284 

4457 



24.9 
22.9 
22.4 
16.8 
34.9 



1308 
1589 
1786 
4683 



87.9 
76.3 
67.5 



7202 
6111 
5006 
18319 

1401 



34.0 
35.4 
35.2 
24.6 
53.4 



1550 
2233 
2552 
6335 



65.9 
52.0 
45.8 



5658 
4161 
3448 
13267 

1051 



2.1 
4.0 
3.6 
2.4 
4.5 



*** 
*** 
** 
*** 



-4 
110 
153 
260 



-3.1 
-2.3 
-3.7 



-328 *** 
-401 *** 
-277 ** 
-1005 *** 



18.0 
14.0 
9.3 
6.6 
13.6 



920 
1183 
1010 
3113 



-7.2 
-5.4 
-5.2 



*** 
*** 



*** 
*** 
*** 
*** 



*** 
*** 
*** 



-695 *** 
-703 *** 
-584 *** 
-1983 *** 



8.6% 
17.5% 
16.1% 
14.4% 
12.8% 



-0.3% 
6.9% 
8.6% 
5.5% 



-3.6% 
-3.0% 
-5.5% 



-4.5% 
-6.6% 
-5.5% 
-5.5% 



53.0% 
39.6% 
26.3% 
26.7% 
25.5% 



59.3% 
53.0% 
39.6% 
49.1% 



•11.0% 
-10.3% 
•11.4% 



-12.3% 
■16.9% 
-16.9% 
-14.9% 



(continued) 
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TABLE 4.1 (continued) 



County and Outcome 



San Diego 

Ever employed (%) 
Yean 
Year 2 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
v^an 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 



Experimental 



Controls 



Difference 



Percentage 
Change 



Sample size (total = 8219) 



Tulare 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 2234) 



46.0 
45.8 
42.5 
31.7 
62.2 



2462 
3503 
3821 
9786 



69.1 
56.0 
49.0 



5529 
4199 
3555 
13283 

7049 



39.9 
41.8 
43.9 
31.4 
59.5 



1792 
2536 
3111 
7439 

76.7 
65.4 
54.5 



6363 
5118 
4171 
15653 

1588 



40.0 
40.8 
37.3 
28.0 
56.5 



2113 
2794 
3108 
8014 



72.1 
61.1 
51.9 



5832 
4679 
3908 
14419 

1170 



40.9 
42.3 
38.0 
26.6 
55.3 



1941 
2531 
2594 
7066 



75.0 
62.2 
56.2 



6231 
5023 
4284 
15538 

646 



6.0 
5.1 
5.2 
3.7 
5.7 



349 
709 
713 



*** 
*** 
*** 
*** 
*** 



*** 
*** 



1772 *** 



-3.1 ** 
-5.1 *** 
-3.0 * 



-302 *** 
-480 *** 
-353 *** 
-1136 *** 



-1.0 

-0.5 
5.8 *** 
4.8 ** 
4.2 ** 



-149 
5 

518 ** 
374 



1.7 
3.1 
-1.7 



132 
95 
-113 
114 



14.9% 
12.4% 
13.9% 
13.4% 
10.0% 



16.5% 
25.4% 
23.0% 
22.1% 



-4.2% 
-8.3% 
-5.7% 



-5.2% 
-10.3% 
-9.0% 
-7.9% 



-2.4% 
-1.2% 
15.3% 
17.9% 
7.6% 



-7.7% 
0.2% 

20.0% 
5.3% 



2.3% 
5.0% 
-3.1% 



2.1% 
1.9% 
-2.6% 
0.7% 



(continued) 
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TABLE 4.1 (continued) 



Percentage 

County and Outcome Experimentals Controls Difference Change 

All counties ta) 



Ever employed (%) 
Yean 
Year 2 
Yearv3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings {$) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 



39.6 
40.5 
39.6 
26.5 
56.7 



1908 
2714 
3159 
7781 



73.4 
61.3 
52.5 



35.5 
35.0 
33.7 
24.1 
50.8 



1642 
2202 
2523 
6367 



76.4 
62.7 
55.5 



4,1 *** 
5.5 *** 
5.9 *** 
4.5 *** 
6.0 *** 



266 *** 
512 *** 
636 *** 
1414 *** 



-3.1 *** 
-14 
-3.0 *** 



1 1 .6% 
15.8% 
17.5% 
18.6% 
11.7% 



16.2% 
23.2% 
25.2% 
22.2% 



-4,0% 
-2.2% 
-5.4% 



Average total AFDC payments received ($) 

Year 1 
■ Year 2 

Year 3 

Total (years 1 -3) 



5963 
4669 
3832 
14464 



6246 
5017 
4163 
15426 



-283 *** 
-347 *** 
-331 *** 
-961 *** 



-4.5% 
-6.9% 
-8.0% 
-6.2% 



Sample size (total = 22791) 



17677 



5114 



SOURCE: MDRC calculations from California Unemployment Insurance (Ul) earnings records and from county' 
AFDC records. 



NOTES: The sample for this table consists of individuals who were randomly assigned as follows: 



Alameda July 1989-May 1990 

Butte March 1988-March 1990 

Los Angeles July 1989 -March 1990 

Riverside August 1988-March 1990 

San Diego August 1988 -September 1989 

Tulare January 1989- June 1990 



The sample used to analyze GAIN'S impacts is slightly smaller than the full research sample. 

Dollar averages include zero values for sample members not employed or not receiving welfare. 
Estimates are regression-adjusted using ordinary least squares, controlling for pre-random assignment 
characteristics of sample members. Rounding may cause slight discrepancies in calculating sums and 
differences. 

For all measures, year 1 refers to follow-up quarters 2-5; year 2, to quarters 6-9; and year 3, to quarters 
10-13. Quarter 1 refers to the calendar quarter in which random assignment occurred. Because quarter 1 
may contain some earnings and AFDC payments from the period prior to random assignment, it is excluded 
from the summary measures of follow-up. 

A two-tailed t-test was applied to differences between experimental and control groups. Statis- 
tical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) In the all-county averages, the results for each county are weighted equally. 
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first three years dropped from $13»267 to $11,284» for a savings of $1,983 per experimental ($695 
in year 1, $703 in year 2, and $584 in year 3), or 14.9 percent of the average payments to controls. 

Three-year earnings impacts in Alameda, Butte, and San Diego fell in a middle range: between 
$1,474 and $1,772. The impact in Butte was not statistically significant, possibly owing to the smaller 
control sample size there. In all three counties, earnings impacts grew by about $300 from year 1 to 
year 2, a trend that can be seen in Figure 4.1. Growth from year 2 to year 3 continued at that rate 
only for Alameda, and the trend there suggests that earnings impacts may be even higher in year 4. 
There was also a growth in earnings impacts from year 2 to year 3 in Butte, although not as large an 
increase as in Alameda, and some of that growth may continue into year 4. In San Diego, the graphs 
indicate that earnings impacts should continue into year 4 but are not likely to grow much more. 

Total AFDC savings over the three-year period ranged from $782 per experimental in Alameda 
(statistically significant) to $976 in Butte (not statistically significant) and $1,136 in San Diego 
(statistically significant). As a percentage of payments to controls, the savings were 4.3 percent for 
Alameda, 7.7 percent for Butte, and 7.9 percent for San Diego. As shown in Figure 4.1, welfare 
savings appear to have peaked in Butte and San Diego during year 2 and then to have declined, a trend 
that continued through year 3. Welfare savings may not have reached a peak in Alameda, where they 
were still climbing through year 3. 

Experimentals in Los Angeles achieved a maximum employment gain of 4.0 percentage points 
during year 2, which declined only slightly to 3.6 percentage points in year 3. However, these gains 
were accompanied by only a small and not statistically significant increase in average earnings of about 
$260 over the three years of follow-up. This earnings impact was smaller than might have been 
expected, given the employment impact, suggesting that a significant share of the jobs found with 
the help of GAIN in Los Angeles led to short-term or intermittent employment or employment that was 
part-time or for lower hourly wages than typical for employed controls. The program in Los Angeles 
did, however, obtain reductions in AFDC receipt and AFDC payments over the follow-up period. By 
quarter 13, 3.7 percentage points fewer experimental than controls were still on AFDC. The savings 
of $1,005 per experimental over three years amounted to a decrease of 5.5 percent of the average 
payment per control. The GAIN program achieved a larger reduction in AFDC during year 2 ($401) 
than during year 3 ($277), and future savings will probably be smaller also. Welfare reductions were 
larger in magnitude than earnings gains in every year, suggesting two possibilities: (1) that even 
employment at earnings levels too low to compensate for the loss of AFDC was enough to induce some 
sample members to leave AFDC or (2). that some sample members remained off AFDC without 
ongoing employment (as measured by administrative records data). Additional information concerning 
these possibilities will be adduced later in this chapter. 

The program in Tulare produced neither earnings gains nor AFDC savings in the first two years 
but began to show effects in year 3. Employment of controls in Tulare fell substantially between year 
2 and year 3, from 42.3 percent to 38.0 percent. In contrast, experimental were able to show an 



^^'he average earnings per control ever employed during the three-year follow-up was $4,683 / 0.349 = 
$13,418. Multiplying this amount by the 0.045 impact on the fraction ever employed during the three-year 
follow-up yields $604, which is the amount the earnings impact would have been had the newly employed 
experimentals earned as much, on average, as employed controls. This amount is more than double the $260 
actually estimated for the three-year earnings impact. 
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increase over the same period, leading to an experimental-control difference of 5.8 percentage points 
in employment in year 3. Earnings impacts also appeared for the first time in year 3. The third year 
impact of $518 produced the largest one-year increase in earnings impacts in any county. No peak 
is evident in the earnings impact estimates, and gains may continue to grow into year 4 or beyond. 
Reductions in AFDC receipt and AFDC payments also began to appear in year 3 in Tulare, although 
tliese were not yet statistically significant. AFDC impacts did not reach a clear peak in year 3 and 
may- grow in year 4. It should be recalled that Tulare was the most rural of the counties, had the 
highest proportion employed in agriculture, and had the highest unemployment rate. More recently, 
however, labor market conditions have improved considerably. Tulare also produced the largest 
impact on GED receipt, which may have produced an increase in earnings with some lag behind 
counties, such as Riverside, that emphasized rapid job entry. 

The three-year earnings gains for Riverside and San Diego are associated largely with an 
increase in employment rather than an increase in earnings per quarter of employment. In other 
words, experimentals worked more as a result of the program, but the jobs they held paid about as 
much, on average, as the jobs held by controls, indicating that hourly wages and weekly hours were 
similar. In Alameda and Butte, approximately half the earnings gains were associated with increased 
earnings per quarter of employment for experimentals.^^ In the nine studies of welfare-to-work 
programs cited previously, usually only a small proportion of earnings gains was associated with higher 
pay rates for experimental group members. 

Analogous calculations for AFDC payments indicate that about two-thirds of the three-year 
welfare savings in Alameda, Los Angeles, Riverside, and San Diego came from fewer months on 
AFDC. The remainder is associated with reduced average grant amounts pbx month of welfare receipt 
for experimentals, possibly the effect of sanctions or an increase in employment while on AFDC.^^ 
Similar patterns were found in those of the nine comparison studies that obtained welfare reductions. 
In Butte, for reasons that are not clear, the contribution of reduced months was much smaller. 
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^^artinson and Friedlander, 1994. 

^^Dividing mean (average) earnings for controls by the mean number of quarters employed (not shown 
in Table 4. 1) gives average earnings per quarter employed for controls. Multiplying this figure by the impact 
on number of quarters of employment (also not shown in the table) tells what the impact on earnings would 
have been if employed experimentals had earned, on average, the same as employed controls. In Alameda, 
this figure is 52 percent of the estimated impact on three-year earnings; in Butte, 52 percent; in Riverside, 
94 percent; in San Diego, 78 percent; and in Tulare (for year 3 rather than all three years), 84 percent. (Year 
3 is used for Tulare because that is the only year with a significant earnings impact.) Earnings impacts in 
Los Angeles were too small to warrant making this calculation. These calculations offer some basis for 
inferring that greater earnings for employed experimentals played a larger role in the earnings impacts of 
Alameda and Butte than in the other counties, but they are not conclusive evidence. 

^^The average monthly payment amount for controls is obtained by dividing the average total dollar 
amount by the average number of months in which AFDC payments were received. Multiplying this figure 
by the reduction in months indicates what the total reduction in AFDC payments would have been had average 
monthly payment amounts been the same for experimentals and controls who remained on welfare. In 
Alameda, this makes up 57 percent of the estimated three-year reduction in AFDC payments; in Butte, 25 
percent; in Los Angeles, 68 percent; in Riverside, 68 percent; in San Diego, 76 percent; and in Tulare (for 
year 3 only), 89 percent. The remainder of the impact on three-year AFDC payments may have come from 
partial grant reductions imposed by sanctions or from part-time employment. Alternatively, the overall reduc- 
tion in months of receipt may have fallen primarily on cases with above-average monthly grant amounts. 
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As shown in Table 4.1, the three-year earnings gains in the six counties ranged from $260 to 
$3,113. There is no one best way to average the results across the six counties. Table 4.2 presents 
the results of three weighting methods. The first method weights each cbimty's impacts equally and 
was used in previous (1992 and 1993) reports on GAIN'S impacts and participation patterns. It yields 
an average earnings increase of $1,414 and an average AFDC decrease of $961 over the three-year 
follow-up period. The second method weights the impacts according to the size of each county's 
GAIN caseload, providing an estimate representing the average impacts of GAIN in the six counties. 
This method yields an average earnings increase of $1,333 and an average AFDC decrease of $1,087 
over the three years of follow-up. The third method weights each county's impacts by the number of 
sample members in the county, which is comparable to pooling all individual observations from all six 
counties. This method produces slightly higher three-year impact estimates: a gain of $1,636 in 
earnings and a savings of $1,166 in AFDC. As can be seen, the three sets of estimates are quite 
similar. The present analysis, like that in the previous report, uses the first method because it is 
simple and does not emphasize the strong or weak results of any one county. The final page of Table 
4. 1 shows all-county average estimates, using this equal-weight method. 



V. Impacts on Earnings Levels 

Impacts on dollar averages can obscure some of the details of program effects. In this seccion, 
impacts on average earnings are broken down into their effects on different levels of earnings. Table 
4.3 gives the percentage of experimental and controls whose earnings for year 3 were in specified 
brackets. (See also Appendix Table D. 8 for a breakdown of earnings keyed to selected hourly wage 
rates.) Year 3 was selected because impacts in that year occurred well after the initial-job-entry effect 
and were most likely to represent the longer-term effects of GAIN. One important bracket divider (or 
"cut point") is $10,000, which is approximately the earnings from a full year's employment at $5 per 
hour for 40 hours per week. This amount is also roughly in the range of the poverty line.-^^ 
Employment may have produced relatively high earnings during the year because the sample member 
had high hourly wages, worked long weekly hours, and/or worked continuously during the year. 
Conversely, employment may have produced low levels of earnings during the year because the sample 
member worked at a low hourly wage, was employed part-time, or was jobless for part of the year. 

The left panel of Table 4.3 shows experimental-control differences in the percentage in each 
earnings bracket. These differences represent unbiased, experimental estimates of the effect of GAIN 
on the distribution of earnings. The ri^t panel gives the percentage in each earnings bracket, counting 
only sample members who had earnings during the year. Thus, the "none" category (i.e., no earnings) 
is blank in the right panel. The "differences" presented in this right panel are not true experimental 
differences because some members of the experimental and control groups were excluded from the 
calculations. They therefore are shown in italics, and no statistical tests were appUed. Tliese right- 
panel differences are useful in determining whether GAIN changed the distribution of earnings among 
employed sample members. The following discussion, however, concerns the full-sample results (the 
left panel of the table). 



^^The poveity line is dependent on family size. For a mother with one child, the poverty line during the 
GAIN evaluation was $9, 190; for a mother with two children, $1 1 ,570; and for a mother with three children, 
$13,950. 
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TABLE 4.3 

GAIN'S IMPACTS ON THE DISTRIBUTION OF EARNINGS IN YEAR 3 FOR AFDC-FGs 



Percent in Annual Earnings Bracket Percent in Annual Earnings Bracket (a) 

Employed Employed 

County and Outcome Experimentals Controls Difference Experimentals Controls Difference 

Alameda 



None 


66.1 


73.3 


-7.2 











$1~$1,999 


11.9 


8.7 


3.2 * 


35.1 


32.6 


2.5 


<^o r\r\r\ <t>i ooo 


o.o 




U.o 


7 O.^ 


on n 
^u. u 


— O.C? 


$5,000— $9,999 


5.7 


4.2 


1 .5 


1 /.U 


ID.O 


4 o 

7.^ 


$10,000— $19,999 


6.9 


5.9 


1 .0 


20.3 


22.0 


--1.7 


$20,000 or more 


3.8 


2.6 


1 .2 


11, 1 


y.o 


1 .D 


Sample size (total =1205) 




























None 


53.3 


57.5 


-4.3 











$1 -$1,999 


14.9 


12.1 


2.8 


31.8 


28.5 


3.3 




1 n n 




— 1 fi 

1 .u 


21.4 


27.3 


—5.9 


$5 000— <1;Q 999 


7.3 


8.5 


— 1 .2 


15.7 


20.1 


-4.4 


$10,000-$1 9,999 


10.6 


7.1 


3.5 * 


22.7 


16.8 


5.9 


$20,000 or more 


3.9 


3.1 


0.8 


8.4 


7.2 


1.1 


Sample size (total =1 229) 














Los Anqeles 














None 


74.0 


77.6 


—3.6 *** 








$1 -$1,999 


7.4 


5.7 


1.8 ** 


28,5 


25.3 


3.2 


$2,000-$4.999 


6.0 


4.8 


1.2 
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SOURCE: See Table 4.1. 



NOTES: See Table 4.1. 

Where data are not applicable, dashes are used. 2 ^ .H 

(a) Estimates in Italics were based only on persons with earning Statistical tests were not applied 
to the differences. 
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A number of important patterns may be detected in Table 4.3. It is clear that the GAIN 
counties increased employment partly above and partly below the $10,000 annual earnings level. For 
example. Riverside increased earnings that were under $10,000 by 5.1 percentage points (a figure 
arrived at by adding the percentage point differences for the three lower earnings brackets) and 
increased earnings of $10,000 or more by 4.2 percentage points (adding the two higher earnings 
brackets). Similarly, San Diego and Tulare both had roughly half their increases in employment below 
$10,000 and half at $10,000 or above. Thus, the effect of GAIN was to increase employment in both 
higher and lower earnings brackets. 

The array of GAIN impacts across counties suggests that employment in the lower earnings 
brackets did not contribute much to the total impacts on earnings in year 3. Four of the five counties 
with earnings impacts over $500 in year 3 (Butte, Riverside, San Diego, and Tulare) had at least a 3.0 
percentage point impact on the percentage of sample members earning at least $10,000. The fifth such 
county, Alameda, had a 1.2 percentage point impact in the top bracket ($20,000 or more), and even 
this small (and not statistically significant) effect may have accounted for as much as half the total 
earnings impact for year 3 in that county.^"* 

Employment impacts in the lower brackets contributed much less to overall earnings impacts, 
and that is why Los Angeles achieved small total earnings impacts (see Table 4.1). The total increase 
in employment in year 3 in Los Angeles was the smallest of the six counties, and most of it was in 
the lower earnings brackets. This lower-bracket employment may have represented short-term or 
intermittent employment that ended during the year. There was only a 1.0 percentage point impact 
at $10,000 or more, the smallest among the six counties, and none of that fell in the $20,000-or-more 
bracket. 



VL Impacts After the Third FoI1ow-Up Year 

Figure 4.2 presents experimental-control differences in earnings and AFDC payments in each 
quarter of follow-up. The impacts are shown separately for the full sample in each county and for its 
sample members who were randomly assigned relatively early in each county, i.e., the county's "early 
cohort." The graphs in Figure 4.2 extend the three-year time frame of Table 4.1 in several ways. 
First, as in Figure 4.1, for Butte, Los Angeles, and Riverside, one additional quarter (quarter 14) of 
follow-up for earnings and two additional quarters (quarters 14 and 15) for AFDC payments are 
available for the full samples and are shown in the graphs; for San Diego, three additional quarters 
(quarters 14 through 16) are shown for both earnings and AFDC payments. Second, the graphs 
include up to 19 quarters of follow-up data for the early cohorts, thereby showing impact estimates 



^"^This proportion was arrived at as follows: An earnings variable was defined as "amount of year 3 
earnings if that amount was $20,000 or more and zero otherwise. " This variable was then used as a dependent 
variable in an impact regression. The coefficient of the experimental status dummy gives the amount of earn- 
ings impact attributable to effects in this earnings bracket. The coefficient was $419, 54 percent of the total 
impact of $774 in year 3! Part of this came from additional experimentals having entered the bracket; part 
may have come from higher earnings for experimentals who would have been in the bracket anyway. The 
estimate is an upper bound of the actual contribution of employment in this category, since it is not known 
what the earnings of the affected experimentals would have been in the absence of GAIN. Many of them 
could have been employed, but in lower earnings brackets. 
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for year 4 (quarters 14 through 17) and part of year 5 (quarters 18 through 21) for a portion of the 
impact sample in some counties. Third, the graphs illustrate the movement of impacts over time - 
i.e., increasing, decreasing, or remaining the same - and can thereby aid in the task of projecting 
impacts into the future. These projections, however, cannot provide the accuracy of actual data for 
the full sample for all of year 4 and beyond. 

Sample sizes for the full samples and early cohorts are shown in Figure 4.2, along with the 
random assignment dates that define the cohorts. Because samples are smaller for the cohorts than for 
the full samples, the precision of the cohort impact estimates is less. The early cohorts in Alameda 
and Butte are the smallest, and the impact estimates in those counties should be considered of 
somewhat lower reliability relative to the others. 

To summarize, the graphs in Figure 4.2 suggest that earnings impacts for the full sample will 
in all likelihood continue after year 3. If so, then the total earnings impact of GAIN will continue to 
improve relative to its own three-year earnings impacts. For AFDC impacts, the graphs suggest some 
tapering off from about the middle of year 2 onward for counties with the largest AFDC impacts. 
This decline continues in year 3 and the observable part of year 4, The decrease is not sharp, 
however, and the trends suggest that cumulative AFDC savings for AFDC-FGs appear likely to 
increase significantly with additional follow-up. 

Both Alameda and Butte show growth in earnings impacts over time for their full samples. The 
impacts for their early cohorts look quite similar to those for their full samples through the end of year 
3 and may continue growing beyond that point. If so, these counties (especially Butte) could, by year 
4, approach the $1,000 annual impact level estimated for Riverside in year 3. In Riverside, however, 
earnings impacts appear to have leveled off by year 3. The early cohort earnings impacts grow from 
quarters 10 through 18, but the full sample shows a slight decline after quarter 10. Los Angeles does 
not show any movement toward significant earnings impacts, in either the full sample or the early 
cohort. As already indicated, earnings impacts in Tulare show a sudden increase beginning in quarter 
9, Both the full sample and the early cohort show similar, steady movement upward through year 3, 
and the result for the extra quarters of the early cohort suggest that this movement may continue in 
year 4. 

San Diego did not show growth in earnings impacts in year 3 or year 4, in the full sample or 
the early cohort. Earnings impacts for the full sample held steady at about $200 per quarter ($800 per 
year) in year 3, but dropped by almost half in year 4. Interestingly, the early cohort impacts on 
earnings and AFDC payments in San Diego are about as large as Riverside's full sample and early 
cohort impacts, as shown in Figure 4.2. In addition, the early cohort earnings impact in San Diego 
does not drop from year 3 to year 4. Impacts for the later cohort were much weaker than those for 
the early cohort. Thus, in Figure 4.2, the full sample curves for San Diego are much closer to zero 
than the early cohort curves. The reason for this difference in impacts across cohorts in San Diego 



^^The date dividing an early cohort from a late cohort within a county is arbitrary, selected for this 
analysis without regard to any changes in the program over time. The object in defining cohorts in each 
county was to maximize the length of follow-up for the early cohort without leaving only a few sample 
members in it. Cohort dates differ across counties. Early and late cohorts may differ in demographic 
characteristics or in the labor markets they faced after random assignment. Both of these differences may have 
contributed to differences in impacts. 
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is not clear. One possibility is that it represents chance variation. A second possibility is that it is the 
product of a change over time in the operation of the program (e.g., an increase in the availability of 
basic education slots over time) or a change in local economic conditions. The difference does not 
appear to arise from a change in the types of people entering the sample in San Diego, since both 
cohorts had quite similar characteristics. Some further results pertaining to early cohorts in San Diego 
and Riverside are presented in the next section. 

AFDC impact curves show similar shapes in Butte, Los Angeles, and San Diego. Experimental- 
control differences peak in year 2 (in quarter 4 in Riverside) and then decline gradually. Riverside's 
AFDC impacts still appear to continue as tlie largest, even at quarter 14, since neither the full sample 
nor the early cohort shows a sharp decrease after the peak. The early cohort in Riverside does not 
differ much from the full sample and is still at about $150 in savings per quarter ($600 per year) in 
year 4. In contrast, Butte, Los Angeles, and San Diego are all in the $50 to $100 per quarter range 
($3(X) to $400 per year) in year 4. Alameda, unlike the other counties, does not show a clear peak 
for the full sample, and the early cohort does not suggest a peak in year 4. AFDC impacts in Tulare 
did not emerge in year 3 when earnings impacts started, but the curves for the full sample and early 
cohort do not definitely rule out such impacts showing up later. 

VIL Three- Year Impacts for Subgroups 

It is possible that only certain types of GAIN registrants may be influenced by the various 
services they are offered by GAIN and the program's participation requirement, thus affecting the 
magnitude of the program's impacts. This section begins with an examination of GAIN'S impacts on 
sample members determined by the program to need or not need basic education - the two major 
subgroups of the research sample. The section then presents the impacts for subgroups defined by 
AFDC history, employment records, ethnicity, and other characteristics. Subgroups are identified 
using information collected for each sample member b^ore the individual was randomly assigned, 
making it possible to create subgroups for both experimentals and controls in the same fashion. For 
this reason, the impacts computed for these subgroups are unbiased, true experimental estimates. 

To summarize, the results of the subgroup analysis indicate that the impacts of GAIN for 
AFDC-FGs were not limited by any particular subgroup or subgroups. In four counties, earnings 
impacts were larger for GAIN registrants deemed not to need basic education than for those deemed 
to need it, while the opposite pattern was found in two others. There was no consistent tendency 
across the counties for AFDC impacts to be larger for one group than for the other. In addition, the 
cross-county distribution of subgroups did not account for county differences in impacts. In particular, 
the small earnings impacts for Los Angeles were not associated with the high proportion of blacks and 
Hispanics, the presence of a refugee minority, or the sizable minority with limited English proficiency. 
The large impacts in Riverside were associated with that county's ability to obtain impacts without 
regard to background characteristics. 

Barriers to employment did not make it impossible for GAIN to achieve impacts on certain 
subgroups. Impacts were found for subgroups with long welfare histories, weak prior employment, 
or larger numbers of children. At the same time, however, earnings impacts were relatively poor for 
a "more disad ^antaged" subgroup, defined as sample members with more tlian two years' previous 
receipt of AFDC, no employment in the year preceding random assignment, and no higli school 

-134- 

ERiC 230 



diploma. Larger earnings impacts for this group may be problematic owing to severe skills deficits 
and multiple barriers to employment. It should be noted, however, that Riverside was able to ^ -.hieve 
large impacts on earnings and AFDC payments for this subgroup, which contributed to that county's 
overall large impact. 

Some individual subgroup results are worthy of mention. The relatively large earnings impacts 
for blacks in Alameda are significant because that sample was drawn from a long-term AFDC 
population in a major inner-city area. In fact, blacks, along with whites, had some of the largest 
impacts generally. On the other hand, it is not clear that the Asian/other category experienced much 
lasting impact from GAIN. 

In judging the magnitude of subgroup impacts, the estimates will sometimes be compared to the 
full sample mean (average) impact for all counties combined, with all counties weighted equally. For 
earnings impacts in year 3, this amount was approximately $600; for AFDC impacts, approximately 
$300 (see Table 4.1). 

Two kinds of statistical tests were applied to subgroup impact estimates. The first was the usual 
test for the statistical significance of the experimental-control difference (i.e., the impact); the results 
are shown in the tables. The second was a test of the variation in impacts across subgroups in a 
county. Where there were two subgroups (e,g., sample members deemed not to need or to need basic 
education), this second test determined whether the amount of difference in the two impact estimates 
was likely to have occurred by chance. In categories with three or more subgroups (e.g,, the "level 
of disadvantage" category, which includes four subgroups), the second test did not look at differences 
between pairs of subgroups, but did determine whether the variation in the set of impacts for all of 
the subgroups in th.at category was likely to have arisen by chance. This second test is discussed in 
notes where appropriate. 

Th^ number of experimentals and controls in each subgroup is smaller than the number in the 
full count> sample. As with the cohort analysis, this reduction in sample size makes the impact 
estimates for subgroups less reliable than impact estimates for the full sample. At times, impact 
amounts that were statistically significant for the full sample will not be statistically significant for a 
subgroup. In some cases, which are flagged in the tables, the reliability of an estimate for a small 
subgroup should be considered very low, even though some of these subgroups may be mentioned in 
the discussion. 

A. Assessed Need for Basic Education 

GAIN registrants vary substantially in their educational attainment and work skills, and the 
GAIN program model explicitly recognizes that different kinds of services might be appropriate for 
individuals depending on these differences. As previously discussed, one of the most innovative 
features of GAIN is the allocation of substantial resources to provide basic education to registrants who 
are judged to need it. An earlier report examined educational impacts for the group judged in need 
of basic education in five of the six GAIN research counties (excluding Butte). That report foimd 
impacts on GED attainment that were very large in Tulare, large in Alameda, modest in San Diego, 



^^Martinson and Friedlander, 1994. 

2 ^ .1 
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and small in Los Angeles and Riverside. It found large gains in achievement test scores in San Diego, 
but no measurable test score gains in any of the other four counties. 

Because GAIN placed so much emphasis on basic education, it is important to determine 
whether the subgroups of GAIN registrants who were deemed to need basic education experienced 
impacts on employment and welfare receipt. Earlier impact reports had too little follow-up data to 
provide a complete picture of the effects of education, the impacts of which, if any, are expected to 
build up slowly but may last a long time. The three years of data now available may still be too short, 
as suggested by the recent appearance of earnings impacts in Tulare and by results from five-year 
follow-up in other evaluations.^^ More than three years' follow-up will be needed for a full 
assessment of GAIN'S effect on those deemed to need basic education and for a comparison of results 
for them with results for those deemed not to need basic education. 

Tables 4.4 and 4.5 present the impacts of GAIN for AFDC-FGs by count}', separately for the 
portions of the samples determined by GAIN not to need and to need basic education. GAIN 
registrants were determined to need basic education if they (1) did not have a high school diploma or 
GED or (2) scored low on either the reading or mathematics part of the CASAS test or (3) were not 
proficient in English. 

The mix of subgroups differed substantially across counties. Less than half of the AFDC-FG 
sample in Butte were judged to need basic education. The typical figure in other counties was close 
to two-thirds; in Los Angeles, it was over 80 percent. For the counties as a group, the preponderance 
of the in-need subgroup, combined with their somewhat higher average AFDC payments, means that 
this subgroup accounted for the bulk of all AFDC expenditures that would have been incurred for the 
GAIN research samples in the absence of GAIN. 

Subgroup sample sizes for Tables 4.4 and 4.5 were at times small and yield less precise dollar 
values for impact estimates in some counties. The least precise dollar amounts are those for both 
subgroups in Butte and for the not-in-need subgroup in Alameda. 

Impacts on earnings and AFDC payments were found for both education subgroups. Earnings 
impacts over three years appeared larger for sample members judged not to need basic education than 
for those judged to need it. In four counties - Alameda, Los Angeles, Riverside, and San Diego - 
the dollar amounts of the three-year earnings impacts were larger for the not-in-need subgroup; but 
in Butte and Tulare, the in-need subgroup obtained the larger earnings impacts. By year 3, the growth 
in earnings impacts began to level off or reached a peak for both subgroups in most of the counties. 
In Tulare, sharp increases in earnings impacts from year 2 to year 3 were observed for both the. not-in- 
need and the in-need subgroups. It was only for die in-need subgroup that the earnings impacts 
attained a moderate level and became statistically significant.^^ 



^''In particular, in the evaluation of the Baltimore Options program, which offered some education and 
training, it was not until follow-up year 5 that earnings impacts substantially exceeded those of some other, 
less intensive programs. See Friedlander and Burtless, forthcoming. 

^^The difference in three-year earnings gains across the education subgroups was statistically significant 
at the 5 percent level in Alameda, Los Angeles, San Diego, and Tulare; the differences in Butte and Riverside 
were not statistically significant. 
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There was no clear tendency for AFDC impacts to be larger for one group than the other. 
Numerically, AFDC reductioris were larger for the not-in-need subgroup in Los Angeles, but for the 
in-need subgroup in Alameda and Butte, AFDC impacts were similar for both subgroups in Riverside 
and San Diego, In these five counties, AFDC impacts did not increase from year 1 to year 2 for either 
subgroup as much as did earnings impacts, and by year 3 the AFDC impacts were beginning to show 
some decline in most cases, Tulare produced AFDC impacts for neither subgroup,^^ 

The finding that San Diego's in-need subgroup had smaller impacts than did the in-need 
subgroup in Riverside is especially notable given the fact that two counties had early cohort earnings 
effects for AFDC-FGs that were quite similar when both education subgroups were combined, as 
discussed in the previous section. Yet, even when the comparison is limited to the in-need subgroup 
of each county's early cohort. Riverside's earnings effects remain larger. For example, the three-year 
earnings impacts were $1,074 in San Diego and $2,347 in Riverside, both statistically significant (not 
shown in tables). It appears, therefore, that despite the similarity of the overall earnings impacts for 
the early cohorts in San Diego and Riverside, the GAIN programs in the two counties may have 
affected their two basic education subgroups in different ways. 

It is of interest to see whether impacts on earnings and AFDC payments for the in-need 
subgroup were linked to education impacts (i.e., impacts on receipt of a GED and on TALS scores). 
Did the in-need subgroup obtain large education effects and large impacts on earnings and AFDC 
payments in the same counties? The answer to this question appears to be no, although there is 
considerable uncertainty surrounding it. In Riverside, Ae in-need subgroup had among the smallest 
education impacts, but had large impacts on earnings and AFDC payments. Conversely, in Alameda, 
San Diego, and Tulare, the in-need subgroup had relatively large education impacts, but had much 
smaller impacts on earnings and AFDC payments than did the same subgroup in Riverside. 
Unfortunately, there are no data on education outcomes for Butte, where the in-need subgroup obtained 
large impacts on earnings and AFDC payments. If the in-need subgroup in Butte had been found to 
have achieved large education impacts, that would affect conclusions about the link between education 
impacts and impacts on earnings and AFDC payments. Nevertheless, the results in Riverside do 
suggest that large impacts on earnings and AFDC payments can be obtained for the in-need subgroup, 
under certain conditions, without impacts on GED or TALS scores. (See Chapter 8 for further 
discussion of this issue,) 

B. Past Welfare Receipt and Prior Earnings 

One of the most important ways in which GAIN registrants differ from one another is in 
whether, and for how long, they have previously received AFDC. Evidence from past research 
indicates that such differences are strongly associated with future AFDC receipt: Individuals with 
several years of previous AFDC receipt are more likely to be on AFDC in the future than are 



^^ith regard to three-year AFDC savings, the differences across the two education subgroups in Butte 
and Los Angeles were both statistically significant at the 5 percent level, but these differences were not 
statistically significant in the other counties. 

^^here are other uncertainties as well. It is possible that the paiticular education outcomes measured - 
receipt of a GED and scores on the TALS literacy test - may not reflect the aspects of GAIN basic education 
most relevant to success in the labor market. It is also possible that the fall impact of education may show 
up only with longer follow-up. 
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individuals who have just started receiving AFDC, The former group — long-term recipients - may 
have greater potential to be a source of welfare savings simply because they are likely to remain on 
welfare longer in the absence of special services. However, long-term recipients often have severe 
skills deficits and other barriers to employment that the welfare-to-work program might not be able 
to overcome. Their greater potential for welfare savings may therefore not be realized in practice. 
For this reason, it is of considerable interest to calculate actual impacts for subgroups with short and 
long welfare histories. Impacts for long-term recipients are also of interest because that subgroup is 
specifically targeted for priority attention by GAIN and JOBS. 

There is another reason for a subgroup analysis by length of welfare history. The counties 
studied for this report differed greatly in the manner in which tliey targeted GAIN services. Alameda 
and Los Angeles worked exclusively with long-term AFDC recipients during the period of sample 
intake: in Alameda, individuals who had been receiving AFDC continuously for more than two years; 
in Los Angeles, for three years or more. Also, Alameda called into the program first those who had 
been on welfare the longest. The other counties worked with a mix of short- and long-termers. These 
cross-county differences may have contributed to differences in impacts, and separate impact estimates 
for long-term recipients may reveal similarities across counties that were not apparent earlier. 

Three subgroups were defined for this analysis. The first consists of sample members who were 
applying for AFDC at the time they were referred to GAIN. This group will be called "applicants," 
even though most of its members became AFDC recipients during the follow-up period. The applicant 
group contains some individuals who had never been on AFDC before and some who were returning 
to AFDC after a pf.riod off the rolls. On average, however, this group had the shortest AFDC 
histories. The second group consists of sample members who were receiving AFDC at the time they 
were referred to GAIN but had a total AFDC history of two years or less (i.e., during their whole 
lives, they had been on AFDC, on their own or their spouse's case, for a total of two years or less). 
This group will be called "short-term recipients." The third group were also receiving AFDC at the 
time they were referred to GAIN, but they had more than two years of lifetime AFDC receipt (on their 
own or their spouse's case). This third group will be referred to as "long-term recipients." 

The first panel of Table 4.6 presents results for welfare history subgroups for each county. 
Because Alameda and Los Angeles worked only with long-term recipients, the table shows results only 
for that subgroup, and these estimates are identical to those shown in Table 4.1 for the full samples 
in those two counties. In the other counties, splitting the samples into three parts reduces the number 
of experimental and controls available for each subgroup impact estimate. The sample is particularly 
small and yields unreliable estimates for the middle subgroup (i.e., short-term recipients) in Butte. 
Also of below-average* eliability are the dollar amounts of estimates for the top and bottom groups 
in Butte and the top ip in Tulare. As in other subgroup impact tables in this report, impacts for 
very small samples aie flagged with the symbol "u" to indicate that these estimates are of low 
reliability.^^ 

Because applicants who were not approved for AFDC were generally not randomly assigned 
and did not enter the research samples, there were relatively few applicants in the GAIN samples 
compared to some earlier studies. Butte had the highest percentage of applicants, 60 percent of its 
sample. Riverside and San Diego had much lower percentages (31 and 28 percent, respectively). 



^^See the discussion in Section II of this chapter. 
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Tulare had very few (14 percent), and Alameda and Los Angeles had none. Across counties, there 
were large differences in the share of long-term recipients, ranging from a little over one-quarter (28 
percent) in Butte, to about 40 percent in Riverside and San Diego, nearly 60 percent in Tulare, and 
the entire samples in Alameda and Los Angeles. 

Welfare history subgroups defined by these objective characteristics do not necessarily behave 
the same across counties. Of particular interest in this connection are Alameda and Los Angeles, 
which, as noted above, focused exclusively on long-term recipients. The behavior of controls can 
reveal what effect this targeting had on the nature of the GAIN caseload in these two counties. As 
shown in Table 4.6, by year 3, control group average earnings and AFDC payments were similar for 
the samples in Alameda and Los Angeles, At the same time, controls in these two counties received 
more AFDC payments in year 3, on average, than did long-term recipient controls in Butte and 
Riverside, but about as much as those in San Diego and Tulare. Their average earnings in year 3 
were similar to those of any long-term recipients in all other counties except San Diego. Consequent- 
ly, the target groups for Alameda and Los Angeles may have been slightly more attached to AFDC 
than were the long-term recipients in some other counties, but it is not clear that they were less 
employable. 

The impact estimates shown in Table 4.6 indicate that groups with a long history of welfare 
receipt can, in fact, experience earnings and AFDC impacts from GAIN. GAIN'S impacts on earnings 
for this group, even though not uniformly strong across all six counties, are of special interest because 
studies of past welfare-to-work programs, particularly those emphasizing job search and work 
experience, have not consistently found improved earnings for long-term recipients. In Alameda, year 
3 impacts on earnings and AFDC payments for the long-term recipients were in the middle range. 
For the long-term recipients in Los Angeles, earnings impacts were small, but AFDC impacts were 
in the middle range. In Riverside, large earnings gains and welfare reductions were obtained for all 
three welfare history subgroups. In San Diego, earnings impacts were relatively small for the long- 
term recipients, but AFDC impacts were relatively large. In Butte, the earnings gains and welfare 
reductions appear to have been concentrated in the two recipient subgroups. In Tulare, the applicant 
subgroup was small. The earnings impacts in year 3 in Tulare are attributable almost entirely to long- 
term recipients, who also obtained modest and not statistically significant AFDC reductions. 

Table 4.6 next shows impacts for sample members who received AFDC continuously, on their 
own or their spouse's case, for less than six years and for six years or more at any time prior to GAIN 
orientation (i.e., the point of random assignment). Los Angeles is not represented in this panel 
because information about length of prior AFDC receipt was not recorded in that county. Throughout, 
Table 4.6 displays subgroups that were likely to have the shortest future AFDC spells near the top, 
and those more likely to receive AFDC for a long time near the bottom. 

Sample members with six years or more of continuous AFDC receipt made up about two-thirds 
of tlie sample in Alameda (and probably constituted the bulk of the sample in Los Angeles as well). 
In the other counties, they were a minority, but an important one. The earnings levels of controls in 
this group were substantially lower than the earnings of controls with less than six years' prior receipt, 
and their AFDC levels were higher. Both subgroups ~ sample members with and without six years 



^^See Appendix Table D.9 for impacts on selected subgroups covering the entire three-year follow-up 
period. 
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or more of prior receipt - appear to have obtained impacts on both earnings and AFDC, although 
most effects were not statistically significant, given the reduced sample sizes available for subgroups. 

Employment in the year prior to GAIN orientation (random assignment) defined the next set of 
subgroups in Table 4.6. Sample members with employment in the preceding year were a small 
minority in Alameda and Los Angeles, but elsewhere those with and without prior employment were 
more evenly represented. Among controls, earnings levels were substantially lower for those without 
prior employment. Typically, earnings for controls without recent employment were less than half 
those of the remainder of the sample. Their AFDC payments were higher, although without such a 
wide disparity. As was the case for the welfare history subgroups, the prior-year-employment 
subgroups did not show a clear pattern of impacts favoring one subgroup or the other, for either 
earnings or AFDC payments. 

The level-of-disadvantage subgroup part of Table 4.6 combines data on AFDC history and prior 
employment and also uses information about completed years of schooling. Applicants are separated 
into those who were first-time applicants and those who were reapplying to AFDC after a period off 
the rolls. Recipients are separated into "less disadvantaged" and "more disadvantaged," The "more 
disadvantaged" category includes recipients who were on AFDC for more than two years, were not 
employed in the year prior to random assignment, and did not have a high school diploma or GED. 
The "less disadvantaged" recipient group comprises all other recipients. 

First-time applicants are of interest because unlike returning applicants and recipients, members 
of this group are at the start of their AFDC careers. Lasting effects could, therefore, affect these 
individuals for a long period of their lives that might otherwise be spent on AFDC, First-time 
applicants, because they have never been on welfare, are also a group new to welfare-to-work 
programs, and so may tell us something about the effects of GAIN on sample members who have 
never before received employment services through the welfare agency. Finally, first-time applicants 
are a group that would always be found in a GAIN program, even after many years of successful 
operation. Other groups, such as long-term recipients, could eventually all become participants and 
in subsequent years would not contribute any new participants to GAIN.^^ Impacts on first-time 
applicants are therefore an indicator of what the impacts of GAIN might be like after a number of 
years of operation. 

First-time applicants, however, are one of the smallest subgroups, which decreases the precision 
of the impact estimates. The Alameda and Los Angeles samples included no first-time applicants. 
This subgroup in Tulare was too small for analysis, and in Butte and San Diego the samples were of 
a size to produce "unreliable" estimates. Nevertheless, it is interesting to note that year 3 earnings 
impacts were large for this group in Riverside and San Diego and were about average in Butte, 
although the estimates were not statistically significant in San Diego or Butte, AFDC impacts were 
also statistically significant only in Riverside, where they were large, AFDC impacts in Butte were 
also relatively large, but were not statistically significant. As a percentage of the control group 
payments, AFDC impacts were 34,2 percent in Riverside and 26.3 percent in Butte, In San Diego, 
the AFDC impacts were smaller but still represented a 7,7 percent reduction relative to the control 



^^First-time applicants are not the only subgroup that would be new tv" GAIN in the long run. Recipients 
whose youngest child had just aged into the category that determines mandatory status would, in most cases, 
also be new to GAIN in the long run. 
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group average. These results suggest that GAIN could be an effective intervention even after several 
years, when a much larger share of new GAIN registrants would be first-time applicants. This 
conclusion is qualified by the small samples involved, however. It is worth noting that first-time 
applicants have not generally shown impacts in other program evaluations,^"* 

At the other end of the spectrum are the more disadvantaged recipients. As shown by the 
outcomes for controls, in the absence of GAIN, this group had quite low earnings and relatively high 
AFDC receipt. Earnings impacts for this group were relatively poor, with only one county (Riverside) 
obtaining an impact greater than $600 in third-year earnings. AFDC impacts were not particularly 
poor, however. Four of the six counties obtained AFDC reductions of $300 or more for this 
subgroup. Thus, the ratio of AFDC impacts to earnings impacts was relatively high for the more 
disadvantaged, a result that is expected on the basis of the prior research cited above. In three of the 
six counties, the dollar amount of the AFDC impact was larger than the corresponding earnings 
impact. 

Finally, in the same previous research, the "returning applicant" group evidenced relatively 
large earnings impacts. This was not the case in GAIN. Earnings impacts for this subgroup were 
relatively large in Riverside and San Diego, but were small in Butte and Tulare. Welfare reductions 
were smallest for returning applicants. 

The foregoing analysis of subgroups defined by AFDC history and prior-year employment 
supports GAIN'S broad, inclusive targeting policy. Impacts were found for a variety of subgroups and 
were not concentrated in one narrowly defined segment of the research sample. This is true for both 
earnings and AFDC impacts and is consistent with earlier research. The earnings impacts for the more 
disadvantaged were relatively weak. In the face of possibly severe skills deficits and multiple barriers 
to employment, it may be quite difficult to increase the earning power of the more disadvantaged 
enough for significant numbers of them to shift from welfare to work. It should be noted, however, 
that Riverside was able to achieve large impacts on earnings and AFDC payments for this subgroup, 
which contributed to that county's overall large impact, 

C. Other Subgroups 

Table 4,6 shows impacts for a number of other subgroups. 

1. Ethnicity , Four ethnic categories were used: white, non-Hispanic; black, non-Hispanic; 
Hispanic; and an "Asian and other" category consisting largely of Southeast Asians. Table 4.6 breaks 
out impacts in year 3 for these subgroups. 

The county GAIN samples were quite varied in ethnic composition. Alameda (70 percent black) 
and Butte (almost entirely white) were the most homogeneous. Whites were in the majority in River- 
side and were the largest group in San Diego, but samples for both those counties were approximately 
one-fifth black and one-quarter Hispanic. Los Angeles was roughly split between large black and 
Hispanic minorities, but also had the largest percentage Asian/other (11 percent), which approximately 
matched the number of whites. Tulare was split between white (52 percent) and Hispanic (39 percent). 



^'^Friedlander, 1988; Friedlander, 1993. 
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There is some evidence that GAIN produced impacts on third-year earnings or AFDC payments 
for all ethnic subgroups except, possibly, the Asian/other category. None of the third-year earnings 
impacts for the Asian/other subgroup were statistically significant, and none reached the $600 mark. 
Among the counties with more than 100 sample members in this subgroup, only San Diego had third- 
year AFDC impacts for the subgroup exceeding $300, and these were not statistically significant. 
Findings presented in an MDRC Working Paper^^ indicate that the Asian/other subgroup had 
relatively low rates of participation in GAIN activities. Thus, low impacts for that group may have 
resulted from their failure to obtain as much GAIN services as other groups. Hispanics also had 
relatively weak results. Among counties with Hispanic samples of more than 100, only Riverside 
achieved earnings impacts over $600 and AFDC impacts of $300. Participation rates for Hispanics 
were not found to be especially low in the earlier paper. A potential cause of the results for Hispanics 
is not evident in the data.^^ 

Blacks and whites appeared to show the largest impacts. Blacks obtained large earnings impacts 
in Alameda. They also obtained earnings impacts at about the $600 all-county average in two of the 
other three counties where the black subgroup estimates are not marked "unreliable," although these 
estimates were not statistically significant. AFDC impacts of $300 or more were found in all four of 
these counties, and were statistically significant in three of them. In fact, AFDC reductions exceeded 
earnings gains in two of the four counties, and the ratio of AFDC reductions to earnings gains 
appeared to be highest for blacks. 

Whites had samples larger than the "unreliable" cutoff in all six counties. Their earnings 
impacts were greater than $600 in three counties and greater than $1,200 in two of those three, 
representing the largest earnings gains for any ethnic group with more than 100 sample members in 
any county. AFDC impacts for whites were close to or over $300 in four of the six counties. Unlike 
blacks, whites had AFDC reductions that were greater than earnings gains in only a minority of 
counties (two of the six). 

The relatively low earnings impacts in Los Angeles were not associated with the high proportion 
of minorities in that sample. Both blacks and Hispanics obtained earnings impacts in some other 
counties, and blacks obtained large earnings impacts in Alameda, which was similar to Los Angeles 
in focusing on long-term AFDC recipients. Furthermore, Hispanics in Los Angeles had earnings 
impacts that were as high as the earnings impacts for whites in that county. Finally, the Asian/other 
category had earnings impacts that were the largest among the ethnic subgroups in Los Angeles. (See 
also the refugee subgroup impacts below.) 

2. Limited English proficiency. Los Angeles was the only county whose sample included 
a sizable minority classified as limited in their English proficiency. Sample members so classified in 
Los Angeles did not have impacts on earnings or AFDC that were any lower than the rest of the 
sample. The presence of this group therefore did not reduce total impacts in that county. 

3. Refugee . More than 10 percent of the AFDC-FG research samples in Butte and Los 
Angeles were refugees. Their presence did not, however, reduce impacts. Earnings gains for them 



^^Friedlander, 1994. 

^^It should be noted that variation in earnings impacts across ethnic subgroups is not statistically significant 
in any county (see Table 4.6). 
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were no smaller than earnings gains for the rest of the sample. AFDC reductions were smaller for 
refugees in Los Angeles but not in Butte. The Butte estimates are marked "unreliable." 

4. Already participating in aa education or training program . In most of the counties, 
about 15 to 20 percent of GAIN sample members were participating in an education or training 
program at the time they attended a GAIN orientation. In general, these individuals were more 
motivated or equipped to work than were the rest of the sample as evidenced by the fact that controls 
in this subgroup, in every one of the six counties, had higher average earnings in year 3 than did 
controls who were not already in such a program. This "job-readiness," however, did not necessarily 
make for larger impacts from GAIN, In none of the six counties were earnings impacts for those who 
were already in a program much greater than earnings impacts for those who were not, and AFDC 
impacts were larger in only two of the six counties. This is not to say that there were no subgroup 
impacts from GAIN. Earnings impacts for this group were at or above $600 in four counties; AFDC 
impacts were at or above $300 in three counties. Only one of the impact estimates was statistically 
significant, but the small sample sizes make it difficult to rule out impacts for this subgroup on the 
basis of statistical tests. 

5. Number of children . In all but one county (Los Angeles), sample members with one 
child were the largest category, although that category was never in the majority. AFDC payments 
for controls were substantially higher for sample members with more children. In all counties, average 
AFDC payments were larger for sample members with two children than for those with one, and were 
larger for those with three or more children than for those with two. Average AFDC payments in year 
3 for sample members with one child were only half to two-thirds the payments to sample members 
with three or more children. Average earnings did not differ markedly across subgroups based on 
number of children. 

The subgroup consisting of those with one child was less likely to show impacts on earnings and 
AFDC payments than were the other two subgroups. In only two of six counties were their earnings 
gains at or over $600, and in only one county were their AFDC reductions more than $300. Thus, 
the fact that this group normally received less in AFDC in the absence of GAIN (as gauged by the 
control group) did not make them more apt to experience impacts from the program. The subgroups 
with two children and with three or more children obtained earnings impacts and AFDC impacts above 
the $6(K)/$300 average impact in the majority of the six counties. 

VIIL Other Outcomes 

This section examines program impacts on Food Stamp receipt and Food Stamp payments; on 
combined total earnings, AFDC, and income from Food Stamps; on income sources for sample 
members with no recorded earnings or AFDC receipt. 

A, Food Stamps 

Table 4.7 presents estimates of Food Stamp receipt and Food Stamp payments for GAIN sample 
members in the six research counties. The table shows experimental and control group averages and 
the difference between the two, which is the estimate of GAIN'S impact. The GAIN research data 
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TABLE 4,7 



GAIN'S THREE-YEAR IMPACTS ON FOOD STAMP RECEIPT BY AFDC-FG REGISTRANTS 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Alameda 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1205) 



94.8 
84.3 
76.7 
70.8 



1161 
1255 
1310 
3726 

602 



95.7 
87.6 
78.2 
74.2 



1151 
1242 
1290 
3683 

603 



-0.9 
-3.3 
-1.5 
-3.4 



10 
13 
20 
42 



-0.9% 
-3.7% 
-1.9% 
-4.6% 

0.8% 
1.1% 
1 .5% 
1 .2% 



Butte 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1229) 



87.6 

61 .e 

49.3 
41 .3 



786 
697 
662 
2144 

986 



88.4 
61.8 
46.4 
39.8 



810 
719 
712 
2241 

243 



-0.8 
-0.2 
2.9 
1.5 

-24 
-23 
-51 
-97 



-0.9% 
-0.3% 
6.2% 
3.9% 



-2.9% 
-3.1% 
-7.1% 
-4.3% 



Los Angeles 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =4396) 



91.2 
74.4 
66.7 
61.0 



1155 
1156 
1199 
3510 

2995 



91.6 
80.2 
72.1 
64.8 



1210 
1248 
1293 
3751 

1401 



-0.4 

-5.7 *** 
-5.3 *** 
-3.8 ** 



-55 *** 
-92 *** 
-93 *** 
-240 *** 



-0.4% 
-7.2% 
-7.4% 
-5.9% 

-4.6% 
-7.4% 
-7.2% 
-6.4% 



Riverside 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =5508) 



81.5 
48.1 
40.0 
36.9 



704 
621 
664 
1988 

4457 



80.0 
53.9 
45.0 
40.1 



759 
683 
735 
2178 

1051 



1.6 
-5.9 *** 
-4 9 *** 
-3.1 * 



-55 *** 
-63 ** 
-71 ** 
-189 *** 



1 .9% 
•10.9% 
-11.0% 
-7.8% 



-7.3% 
-9.2% 
-9.7% 
-8.7% 



(continued) 




TABLE 47 (continued) 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



San Diego 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =8219) 



89.0 
62.4 
52.3 
46.8 



831 
773 
810 
2414 

7049 



89.1 
64.2 
55.9 
48.3 



856 
846 
859 
2561 

1170 



-0.2 
-1.8 
-3.6 
-1.5 



-26 
-72 
-48 
-147 



-0.2% 
-2.7% 
-6.5% 
-3.2% 



-3.0% 
-8.6% 
-5.6% 
-5.7% 



Tulare 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Yean 
Year 2 
Years 

Total (years 1 -3) 
Sample size (total =2234) 



90.4 
69.2 
63.2 
55.0 



989 
1057 
1072 
3118 

1588 



89.0 
67.7 
59.1 
55.5 



961 
999 
1050 
3010 

646 



1.4 
1.4 
4.1 
-0.5 



28 
58 

22 
108 



1 .5% 
2.1% 
7.0% 
-1.0% 



2.9% 
5.8% 
2.1% 
3.6% 



All counties (a) 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of years - 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Years 

Total (years 1 -3) 
Sample size (total=22791) 



89.1 
66.7 
58.0 
52.0 



938 
926 
953 
2817 

17677 



89.0 
69.2 
59.4 
53.8 



958 
956 
990 
2904 

5114 



0.1 
-2.6 
-1.4 
-1.8 



-20 * 
-30 ** 
-37 ** 
-87 ** 



0.1% 
-3.7% 
-2.3% 
-3.4% 



•2.1% 
-3.1% 
-3.7% 
-3.0% 



SOURCE: MDRC calculations are from county Food Stamp records. 

NOTES. See Table 4.1 . 

(a) In the all-county averages, the results for each county are weighted equally. 
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record the dollar value of Food Stamps given to the household of which the research sample member 
and her family are a part."^^ Food Stamp estimates were based on the full sample in each county. 

Average Food Stamp payments to controls over the three-year follow-up period were about one- 
fifth of AFDC payments for the same period. The ratio of Food Stamps to AFDC for controls was 
similar across counties. Food Stamp amounts for controls were higher in Alameda and Los Angeles 
than in the other counties, which would be expected, since those counties focus on long-term AFDC 
recipients. 

The percentage of controls receiving Food Stamps declined over time, as did the percentage 
receiving AFDC payments. Interestingly, however, the average Food Stamp amounts received by 
controls did not decline over time. To explain this, an average was calculated for Food Stamp dollars 
in quarters when Food Stamps were received. It was found that average Food Stamp amounts per 
quarter received were larger for sample members who were still receiving Food Stamps at the end of 
follow-up. In addition. Food Stamp amounts per quarter received increased for sample members who 
were still receiving them at the end of follow-up. Thus, sample members who eventually went off 
Food Stamps had lower quarterly Food Stamp amounts, and those who remained on had not only 
higher quarterly Food Stamp amounts but also Food Stamp amounts that increased over time. Why 
this should be is unclear, but it accounts for the fact that the average Food Stamp amount for all 
sample members did not decline over time even as the percentage receiving Food Stamps did. 

Impacts on Food Stamps were found for several counties but were not produced as consistently 
as impacts on AFDC. As shown in Table 4.7, statistically significant impacts on Food Stamps were 
found in Los Angeles, Riverside, and San Diego. Smaller and not statistically significant impacts were 
found in Butte. Los Angeles and Riverside had the largest reductions in percentage receiving Food 
Stamps. Los Angeles had the largest dollar savings, $240 per sample member over three years 
(statistically significant). Riverside was a close second, however, and that county had the largest 
reduction as a percentage of the control group average: The reduction in Food Stamp payments over 
three years amounted to 8.7 percent of the amounts paid to controls. Dollar reductions in San Diego 
were in the same range but, unlike those in Los Angeles and Riverside, were begimiing the fade by 
year 3. 

The magnitude of savings in public assistance associated with Food Stamps was less than for 
AFDC. Impacts on Food Stamp payments in the three counties that had them were about 10 to 20 



^''The Food Stamp household and the AFDC family are not necessarily identical. In some Food Stamp 
cases, individuals not on the AFDC case (e.g., a grandmother living with her daughter, who is the AFDC case 
head) will receive Food Stamps. It is not possible to separate out the amount of Food Stamps going just to 
those persons who are on the AFDC case of sample members. For this reason, the amounts of Food Stamps 
going to experimentals and controls are overestimated in this report. Estimates of the differences in Food 
Stamp amounts between experimentals and controls (i.e. , program impacts on Food Stamps) will not be biased 
unless GAIN had an effect on the rate of breakup of Food Stamp households. 

■'^The ratio of Food Stamp payments to AFDC payments was also slightiy higher in Alameda and Los 
Angeles than in the other counties. The lowest ratio was found in Riverside. 

■'^For example, in quarter 9, Food Stamp amounts were 22 percent larger for sample members who would 
still be receiving them in quarter 13 than for those who would not. Moreover, Food Stamp amounts during 
quarters when they were received grew 44 percent from quarter 2 through quarter 13 for those who were 
receiving them in quarter 13. 
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percent of the corresponding AFDC impacts over the three-year follow-up. Savings in Food Stamps 
in two of these three counties and in Tiuiie do not evidence any decline over time, and total savings 
should grow with additional years of follow-up. For all six counties, the three-year reduction in Food 
Stamps was $87, a statistically significant impact, amounting to 3.0 percent of average payments to 
controls. The dollar amount was about one-tenth of the all-county impact on AFDC payments; the 
percentage change was about half the percentage change in AFDC payments. 

B. Combined Income from Earnin2s, AFDC v and Food Stamps 

The sum of earnings, AFDC, and Food Stamps is a partial measure of family income. The 
earnings of a sample member, her AFDC benefits, and the Food Stamps going to her household are 
not the only sources of income. Contributions may also come from the noncustodial parent and from 
other family members. Some sample members also receive Unemployment Insurance (UI) benefits 
and other transfer payments. Nevertheless, these three income sources are the ones that GAIN is 
primarily intended to affect. Table 4.8 gives impacts on combined income from earnings, AFDC, and 
Food Stamps in the last quarter of follow-up (quarter 13). 

Impacts on the average total value of earnings, AFDC, and Food Stamps were modest. As 
shown in Table 4.8, the largest effect was in Tulare - an increase of $149 (statistically significant), 
or 8.0 percent of the eamings/AFDC/Food Stamp income of controls in the same quarter. In other 
counties, AFDC reductions offset more of the earnings gains. A 5.4 percent increase in earnings/ 
AFDC/Food Stamp income (relative to controls) was realized in Alameda and a 4.7 percent increase 
in Riverside, but neither of these effects was statistically significant. For the pooled sample of all 
counties (weighted equally), the average impact was a 3.1 percent increase ip eamings/AFDC/Food 
Stamp income (relative to controls), which was statistically significant. 

Table 4.8 also shows the percentage of experimental and controls receiving income from 
combinations of the three sources. GAIN reduced the incidence of "welfare without work," moving 
some people into jobs and off AFDC completely and others into jobs at which they worked while they 
remained on AFDC. All six counties showed a decrease in the percentage of experimentals who were 
on AFDC and had no earnings at the end of the third follow-up year. This decrease ranged between 
four and seven percentage points and was statistically significant in five of the six counties; not all of 
the experimentals who left this status were off AFDC and also had earnings. Increases in the share 
of experimentals who had earnings but no AFDC ranged from less than 1 percentage point to a 
maximum of 4.6 percentage points. In some counties, there was an increase in the percentage 
receiving both earnings and AFDC in the last quarter, but the largest of these effects was an increase 
of 2.5 percentage points. 

Many experimentals went off AFDC without having earnings. So did many controls. In Table 
4.8, these sample members are in the category "no AFDC or earnings," The absence of recorded 
earnings or AFDC does not mean that a sample member had no income. A large number of AFDC 
case heads who leave AFDC do so because they get married or become reconciled with an absent 
spouse, or they may receive contributions from other family members. Zero earnings and AFDC 
amounts will also be recorded for individuals who leave the state or county. 

GAIN appeared to have had no overall effect in getting people off welfare if they could not find 
or keep a job. Across counties, between one-fifth and one-third of controls had no earnings or AFDC 
at the end of year 3, In no county, however, was there a statistically significant increase in the per- 
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TABLE 4.8 



GAIN'S IMPACTS ON TOTAL EARNINGS/ AFDC/ FOOD STAMP INCOME AND INCOME SOURCES 
IN THE LAST QUARTER OF YEAR 3 FOR AFDC-FG REGISTRANTS 



ERLC 



County and Outcome 


Experimental 


Controls 


Difference 


Percentage 
Change 


Alameda 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


2221 


2108 


113 


5.4% 


Income sources (%) 
Earnings without AFDC 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


1 4.«i 
10.6 
56.9 
18.3 
100.0 


inn 
I U.U 

8.8 

61.8 

19.4 

100.0 


1.8 
-4.9 * 
-1.1 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


4.6 
13.6 


5.3 
14.1 


-0.7 
-0.4 




Sample size (total =1205) 


602 


603 






Butte 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


1738 


1708 


29 


1.7% 


Income sources (%) 
earnings wknoui MrUL/ 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


oo ft 
10.1 
29.6 
37.5 
100.0 


oo n 
7.6 
33.4 
37.0 
100.0 


n ft 
2.5 
-3.8 
0.5 




Food Stamps without AFDC or earnings 
No Food Stamps. AFDC. or earnings 


3.7 

33.9 


3.2 
33.8 


0.5 
0.1 




Sample size (total =1229) 


986 


243 






Los Angeles 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


1872 


1932 


-60 


-3.1% 


Income sources (%) 
earnings wiinouT ArUL/ 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


8.1 
55.7 
25.0 
100.0 


Q 1 

7.7 
59.8 
23.4 
100.0 


9 1** 

^. 1 

0.3 
-4.1 ** 
1.6 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


1.6 
23.5 


1.5 
21.9 


0.1 
1.5 




Sample size (total =4396) 


2995 


1401 






Riverside 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


1722 


1645 


77 


4.7% 


Income sources (%) 
Earnings without AFDC 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


23.0 
8.2 
32.4 
36.4 
100.0 


18.4 
6.2 
39.6 
35.8 
100.0 


4.6 *** 
2.0 ** 
—7 2 *** 

0.7 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


2.5 
33.9 


1.4 
34.4 


1.1 ** 
-0.5 




Sample size (total =5508) 


4457 


1051 














(continued) 
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TABLE 4.8 (continued) 



County and Outcome 


Experimental 


Controls 


Difference 


Percentage 
Change 


San DIeao 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


2002 


1964 


39 


2.0% 


Income sources (%) 
Earnings without AFDC 

Parninn^ anH APDO 
c^cii 1 lit IU9 cii lu rytLyy^ 

AFDC without earnings 
rvjo Mruo anu no earnings 
Total 


21 .4 

1 v.O 

38.7 
100.0 


18.8 
9.1 
42.8 

100.0 


2.6 ** 
1 .2 
—4.1 *** 

n A 




Food Stamos without AFDC or earninas 
No Food Stamps, AFDC, or earnings 


2.1 
27.6 


1 .9 
27.3 


0.1 
0.2 




Sample size (total =82 19) 


7049 


1170 






Tulare 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


2014 


1865 


149 ** 


8.0% 


Income sources (%) 
Earnings without AFDC 

Ca,i 1 lit at lU r\iU\^ 

AFDC without earnings 
No AFDC and no earnings 
Total 


19.9 

1 1 .o 

43.0 
100.0 


17.6 
Q n 

47.1 
26.3 
100.0 


2.3 
o c * 

-4.2 * 
—O.b 




FnnH fitamn^ withniit AFnr"i or parninn^ 
nwvyd OLCiiii^o vviLiivyuL ryi Ly\^ yji cfciitiitiuo 

No Food Stamps, AFDC, or earnings 


2.5 
23.1 


3.7 
22.5 


— 1 .2 
0.6 




Sample size (total =2234) 


1568 


646 






All counties (a) 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


1928 


1870 


58 * 


3.1% 


income sources (%) 
Earnings without AFDC 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


18.8 
9.8 
42.7 
28.8 
100.0 


16.0 
8.1 
47.4 
28.5 
100.0 


2.8 *** 

^ y *** 
_4 y *** 

0.3 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


2.8 
25.9 


2.8 
25.7 


-0.0 
0.3 




Sample size (total =22791) 


17677 


5114 







SOURCE: See Tables 4.1 and 4.10. 



NOTES: See Table 4.1. 

(a) In the all-county averages, the results for each county are weighted equally. 
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centage of experimentals off welfare and without work. The all-county impact estimate was only a 
0.3 percentage point increase in this category, which was not statistically significant. Nevertheless, 
it is of interest to note that Los Angeles, which was the only county with a negative effect on earnings/ 
AFDC/Food Stamp income, also had the largest shift into the no-AFDC/no-eamings category (1.6 
percentage points). Part of the small reduction in earnings/ AFDC/Food Stamp income in Los Angeles 
is undoubtedly associated with the small increase in the share of experimentals who were off AFDC 
but did not work. Those experimentals may have left AFDC without having a job or may have had 
a job and lost it and not returned to AFDC, The increase in the no-eamings/no-AFDC category, 
although small, increased the ratio of impacts on AFDC payments to impacts on earnings and is one 
of the reasons why Los Angeles obtained moderately large AFDC impacts with only small earnings 
impacts. It should be added that neither the reduction in eamings/AFDC/Food Stamp income nor the 
shift into the no-AFDC/no-eamings category in Los Angeles was statistically significant. 

The last two rows of Table 4.8 indicate that Food Stamp receipt does not alter the picture just 
described. The table shows that very few experimentals or controls received Food Stamps in quarter 
13 without receiving AFDC or earnings. There were no important impacts on the percentage receiving 
"Food Stamps without AFDC or earnings." Finally, the table shows that between one-seventh and 
one-third of sample members had no eamings/AFDC/Food Stamp income at the end of the year 3, 
This group makes up almost all of the group with no earnings and no AFDC, and there were no 
impacts on tliis status, either, 

C. Income for Sample Members Without Earnings or AFDC 

Almost all sample members who did not have earnings or AFDC income did have other possible 
sources of income. Table 4,9 provides information on the possible sources of income for the 
subsample of GAIN survey respondents who reported no earnings of their own and no AFDC 
payments of their own in the month prior to the interview. About a quarter of the experimentals in 
that group were married and living with a spouse. Nearly half the group reported that they received 
or were living with someone who received non-employment income from a source other than AFDC 
or Food Stamps. Only about a quarter of the group said that they did not receive or live with anyone 
who received income from any source. 

D. Family Poverty 

To estimate the effects of GAIN on poverty, the total of third-year earnings, AFDC payments, 
and Food Stamp payments, referred to here as "eamings/AFDC/Food Stamps income," was estimated 
for experimentals and controls and compared to the government's official poverty line, which varies 
by family size. However, this combined income differs from the government's official poverty 
measure in that it counts the value of Food Stamps as income, but does not include income of other 
family members (e.g. , other family members' earnings) that are normally counted in estimating poverty 
rates. Furthermore, the GAIN evaluation data on family size used in this part of the analysis only 
cover family size at the time of random assignment; changes in family size (e,g., through the birth of 
another child or marriage), which would affect official poverty levels, are not considered. Thus, the 
analysis can provide only an approximation of GAIN'S impact on poverty. 

Table 4,10 gives the percentage of experimentals and controls with eamings/AFDC/Food 
Stamps income for year 3 above the poverty line. Estimates are also shown for families of different 
sizes (as observed at the time of random assignment). In every county, GAIN increased the percentage 
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TABLE 4.9 



MARITAL STATUS AND ALTERNATIVE SOURCES OF INCOME 
FOR AFDC-FG SURVEY RESPONDENTS IN FOUR COUNTIES 
WHO REPORTED NO EARNINGS OF THEIR OWN AND NO AFDC PAYMENTS OF THEIR OWN 
IN THE MONTH PRIOR TO INTERVIEW, BY RESEARCH GROUP 



Outcome Measure 



Respondents with No Reported Earnings or AFDC Payments 
in the Month Prior to Interview 



Experimental (%) 



Controls (%) 



Married and living with spouse 



29.1 



25.9 



Living with a partner without 
being married 



9.6 



13.2 



Living with someone who received 
Income from the following sources 
in the prior month: 
Employment from regular or 

irregular job 
AFDC or Food Stamps 
At least one of these sources 



28.1 
14.0 
39.4 



25.5 
20.6 
44.6 



Received or living with someone who 
received money from the following 
sources in the prior month: 

Child support 

Alimony 

SSI 

Social Security 
Unemployment Insurance 
Worker's Compensation 
General Assistance 
Family or friends outside the 

household 
At least one of these sources 
Any other source 



9.6 
0.7 
13.4 
7.5 
7.5 
2.7 
3.1 

6.5 
45.2 
8.6 



6.4 

0.0 
14.5 
8.6 
5.5 
1.8 
7.8 

5.0 
42.7 

5.9 



Reported not to have received or 
lived with anyone who received 
income from any source (a) 



24.3 



25.5 



Sample size 



292 



220 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: The sample covers four counties: Alameda, Riverside, San Diego, and Tulare. 

Estimates are not regression-adjusted. Comparisons be^veen experimental and controls are not true 
experimental comparisons. Statistical tests for such comparisons were not performed. 

(a) Experimentals in this category constitute 4.2 percent of all AFDC-FG experimental group survey 
respondents in the four counties; controls in this category constitute 4.0 percent of all AFDC-FG control group 
survey respondents in the four counties. 
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TABLE 4.10 

APPROXIMATION OF GAIN'S IMPACT ON POVERPT IN YEAR 3 FOR AFDC-FG REGISTRANTS 



Sample Size 



Percent with Measured Income 
(Earnings, AFDC Payments, and Food Stamps) 



Subsample and County 


Experimental 


Controls 


Experimental (%) 


Controls (%) 


Difference (%) 


All reaistrants 












r\lcU 1 ICUa 


602 


603 


22.4 


19.8 


2.6 


Butte 


yoD 




19.8 


15.0 


4.8 * 


Los Angeles 




14U1 


13.7 


11.6 


2.0 * 


Riverside 


4457 


1051 


19.4 


15.7 


3.7 *'^* 


San Diego 


7049 


1170 


23.1 


20.9 


2.2 * 


Tulare 


1588 


646 


22.9 


18.4 


4.5 ** 


All counties (b) 


17677 


5114 


20.2 


16.9 


3.3 *** 


Registrants with one 






Total measured income exceeds $ 9,190 (d) 


child at orientation (c) 












Alameda 


266 


252 


25.2 


24.6 


0.5 


Butte 


473 


129 


23.3 


13.7 


9.6 *** 


Los Angeles 


994 


464 


18.4 


16.9 


1.4 


Riverside 


1828 


463 


22.3 


20.3 


2.1 


San Diego 


3332 


548 


27.0 


25.5 


1.5 


Tulare 


621 


236 


28.3 


20.9 


7.4 ** 


Registrants with two 






Total measured 


income exceeds $ 1 1 ,570 (e) 


children at orientation 












Alameda 


189 


195 


26.6 


19.4 


7.2 * 


Butte 


348 


64 


18.6 


22.0 


-3.4 


Los Angeles 


957 


439 


15.8 


10.0 


5.8 *** 


Riverside 


1498 


328 


21.1 


12.6 


8.6 *** 


San Diego 


2233 


386 


23.3 


19.5 


3.8 * 


Tulare 


532 


207 


22.0 


16.8 


5.3 * 


Registrants with three or 






Total measured 


income exceeds $ 13,950 (f) 


more children at orientation 












Alameda 


147 


156 


12.4 


12.0 


0.3 


Butte 


165 


50 


12.4 


9.0 


3.4 U 


Los Angeles 


1044 


498 


7.4 


8.0 


-0.6 


Riverside 


1131 


260 


12.2 


12.1 


0.1 


San Diego 


1484 


236 


14.2 


12.8 


1.4 


Tulare 


435 


203 


11.9 


11.5 


0.3 



SOURCE: See Table 4.1. 



NOTES: See Table 4.1 . 

The symbol "u" indicates that, because of very small sample sizes, the impact estimate shown is unreliable; 
asterisks folbwing the symbol indicate that there was a statistically significant effect, though its magnitude could not be 
reliably measured. 

(a) This estimate assumes that registrants' family size and composition did not change between orientation and 
the end of follow-up. 

(b) The six counties are weighted equally. 

(c) This sample includes those reporting zero children at orientation. 

(d) This dollar amount is the 1992 poverty line for a two- person family. 

(e) This dollar amount is the 1992 poverty line for a three-person family. 

(f) This dollar amount is the 1992 poverty line for a four-person family. 
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of families with total eamings/AFDC/Food Stamps income above the poverty line. These effects were 
statistically significant in five of the six counties. The all-county average was positive and statistically 
significant: 20.2 percent of experimentals were above the poverty Une in year 3 compared to 16.9 
percent of controls, for a difference of 3.3 percentage points. 

These effects occurred almost exclusively among smaller families, those with one or two 
children. The most consistent gains were for families with two children. For that group, impacts 
were found in every county but Butte, where the sample for that subgroup was small and the precision 
of the estimate therefore reduced. For families with one child, large effects were found in Butte and 
Tulare. Among sample members with three or more children, effects were close to zero everywhere 
except in Butte, where the very small subgroup sample makes the estimate unreliable. 

This distribution of effects - larger reductions in poverty for smaller families - is influenced 
by the relationship of the poverty line to family size. The higher poverty line for larger families 
implies that an earnings gain large enough to push a smaller family's income above the poverty line 
may not be large enough to push a larger family's income above it."^ 



IX. The Riverside Case Management Experiment 

As discussed in Chapter 1, an additional feature of the GAIN evaluation is a special study 
conducted in Riverside County on the effects of assigning GAIN registrants to case managers with 
different-size caseloads. Case managers in one group (the "enhanced" group) were assigned half as 
many registrants as case managers in the other group (the "regular" group). Although the actual 
average ratio of registrants to case managers fluctuated over time, the 2-to-l difference was maintained 
throughout the random assignment period and for approximately a year thereafter. Furthermore, all 
case managers, as well as registrants in the experimental group, were randomly assigned to either the 
higher- or lower-caseload group. 

This special experiment was designed to test whether assigning registrants to staff with smaller 
caseloads, and allowing staff to monitor them more closely and work with them more intensively, 
would produce larger impacts on earnings and AFDC. This did not occur, however. Both the 
enhanced and regular experimental groups obtained large gains in earnings and large reductions in 



'^he impacts on poverty estimated in Table 4. 10 do not necessarily parallel the impacts on total earnings/ 
AFDC/Food Stamps income discussed earlier. In Los Angeles, the small increase in the percentage of 
families above the poverty line shown in Table 4. 10 appears not to accord with the negative effect in quarter 
13 on total eamings/AFDC/Food Stamps income shown in Table 4.8. The poverty estimate is based on the 
same income measure, so how can there be apparendy opposite effects? In actuality, the poverty impact for 
Los Angeles is a combination of two opposing effects: an increase in eamings/AFDC/Food Stamps income 
for some experimentals as a result of GAIN and a decrease for others. Some experimentals whose combined 
income would have been between half the poverty line and the poverty line saw their income rise above the 
poverty line, and the result of that movement is captured in Table 4. 10. Some experimentals whose combined 
income would have been between half the poverty line and the poverty line saw their income fall below half 
the poverty line or to zero measured eamings/AFDC/Food Stamps income. That movement is not captured 
in Table 4.10, but it does offset the positive movement and accounts for the overall small negative income 
effect shown in Table 4.8. These effects occur in Los Angeles in the subgroup of program registrants with 
two children. 
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AFDC. But these impacts were not greater for the enhanced group. In fact, earnings impacts were 
somewhat larger for the regular group than for the enhanced group. AFDC reductions started out 
larger for the enhanced group in the first follow-up year, but this difference did not continue into later 
years. It appears, therefore, that the size of a case manager's caseload did not affect the success of 
the GAIN participant, except for a possible small initial increase in AFDC savings. 

Results of the Riverside case management experiment for AFDC-FGs are shown in Table 4,11. 
The average total three-year earnings for the enhanced group were $8,957 compared to $6,337 for the 
control group, for an impact of $2,620. The average three-year total earnings for the regular group 
were $9,604, for an impact of $3,267. Thus, earnings impacts were slightly larger for the regular 
group. The difference of $646 was not statistically significant over the whole three-year period. The 
difference in earnings impacts was statistically significant in year 3. 

The average total three-year AFDC payments for the enhanced group were $11,194 compared 
to $13,267 for controls, for an impact of $2,074. The average total three-year AFDC payments for 
the regular group were $11,313, for an impact of $1,954. The difference in AFDC impacts between 
the enhanced group and regular group was $120 in additional savings for the enhanced group. This 
difference was not statistically significant. 

One possible explanation for the absence of additional impacts from reduced caseloads may be 
that the Riverside sample was less likely than the samples in other counties to stay on AFDC a long 
time. Riverside controls had the second-lowest percentage still on AFDC at the end of the three-year 
follow-up period (see Table 4. 1); only Butte had a lower percentage. It may be that the additional case 
management services went to sample members who would have left AFDC soon anyway. Enhanced 
case management services might produce additional impacts if they could be targeted to program 
registrants who were likely to still be on AFDC and not working after having received the standard 
level of services. 



X* Impacts on AFDC-FGs with Children Under A2e 6 

The JOBS legislation broadened the definition of "mandatory" for welfare-to-work programs 
by including single parents with a child aged 3 to 5 (and allowing states to lower that to age 1 if they 
wished). Rules in effect prior to JOBS allowed programs to classify single mothers with a child under 
age 6 as mandatory only under special circumstances, and only a small fraction of program enroUees 
were so classified. The "new JOBS mandatories" make up a large fraction of JOBS program enrol- 
lees. It is therefore an important question whether welfare-to-work programs can produce impacts on 
this group. Little evidence is available from the program evaluations of the 1980s. The GAIN 
evaluation can provide some information, since it includes a supplementary sample of individuals who 
became mandatory for GAIN after the transition to JOBS took effect. 

Table 4,12 presents impact estimates for a three-county supplementary sample of GAIN 
registrants who had a chila under age 6. The counties were Alameda, Riverside, and Tulare."^^ In 
Riverside and Tulare, the intake process identified new JOBS mandatories at the time of random 
assignment, and it was therefore possible to separate this supplementary sample from the research 



ERIC 



'*'Butte worked with some new JOBS mandatories also, but the subsample there was too small to analyze. 
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TABLE 4.12 

GAIN'S THREE- YEAR IMPACTS ON EMPLOYMENT, EARNINGS. AFDC RECEIPT, AND AFDC PAYMENTS 
FOR AFDC-FG MANDATORY GAIN REGISTRANTS WITH CHILDREN UNDER AGE 6, 
IN ALAMEDA, RIVERSIDE, AND TULARE COUNTIES 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Alameda 

(sample includes children 
of any age under 6) 

Ever employed (%) 
Yean 
Year 2 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 



Sample size (total = 367) 
Riverside 

(sample includes children 
3 to 5 years old) 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 



Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1820) 



34.9 
34.2 
39.2 
28.9 
53.2 



1503 
2461 
3376 
7340 



86.1 
77.2 
68.6 



7265 
6250 
5469 
18983 

191 



52.2 
45.4 
41.2 
27.5 
66.2 



2248 
2796 
2917 
7961 



67.2 
56.5 
49.5 



5708 
4388 
3733 
13829 

1449 



28.0 
28.2 
30.2 
20.3 
43.4 



1240 
1568 
2311 
5120 



90.1 
77.6 
72.1 



7387 
6394 
5749 
19530 

176 



29.8 
26.8 
28.9 
18.6 
46.2 



1038 
1605 
1807 
4450 



75.7 
64.4 
57.9 



6454 
5263 
4670 
16387 

371 



6.9 
6.0 

9.1 ** 
8.6 * 
9.8 ** 



263 
893 
1065 
2220 



-4.1 
-0.5 
-3.5 



-123 
-144 
-280 
-547 



22.5 *** 

18.6 *** 
12.3 *** 

8.9 *** 
20.0 *** 



1210 *** 
1190 *** 
1110 *** 
3511 *** 



-8.5 *** 
-7.8 *** 
-8.4 *** 



-746 *** 
-875 *** 
-938 *** 
-2558 *** 



24.6% 
21 .4% 
30.0% 
42.2% 
22.6% 



21.2% 
56.9% 
46.1% 
43.4% 



-4.5% 
-0.6% 
-4.8% 



-1.7% 
-2.3% 
-4.9% 
-2.8% 



75.5% 
69.7% 
42.4% 
47.7% 
43.2% 



116.6% 
74.2% 
61 .5% 
78.9% 



-11.3% 
-12.2% 
-14.6% 



-11.6% 
-16.6% 
-20.1% 
-15.6% 



(continued) 



ERLC 



TABLE 4,12 (continued) 



County and Outcome 



Experimentals 



Controls 



Di.'rerence 



Percentage 
Change 



Tulare 

(sample includes children 
3 to 5 years old) 

Ever employed (%) 
Yean 
Years 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Years 

Total (years 1 -3) 



Sample size (total = 493) 



30.3 
31.0 
36.0 
24.1 
52.0 



1493 
1924 
2394 
5812 



85.7 
72.9 
69.0 



7602 
6465 
5412 
19479 

288 



29.2 
32.0 
33.8 
26.6 
44.1 



1429 
1810 
2437 
5675 



76.2 
71.7 
65.0 



7058 
6027 
5246 
18331 

205 



SOURCE AND NOTES: See Table 4.1 and Appendix D. 



1.1 
-1.0 

2.2 
-2.4 

7.9 



64 
114 
-42 
136 



g 4 *** 

1.1 

4.1 



544 
437 
167 
1148 



3.3% 
-3.2% 

6.7% 
-9.2% 
17.9% 



4.5% 
6.3% 
-1.7% 
2.4% 



12.4% 
1.6% 
6.3% 



7.7% 
7.3% 
3.2% 
6.3% 
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sample analyzed in the rest of this chapter. In Alameda, new JOBS mandatories were not clearly 
distinguished in the intake process from other sample members with children under 6. All AFDC case 
heads with children under age 6 (both new JOBS mandatories and pre-JOBS mandatories) were there- 
fore treated as part of the main Alameda sample analyzed up to this point. In this respect, the main 
analysis sample in Alameda differed from those of the other five counties, which did not include new 
JOBS mandatories and for that reason had fewer people with children under age 6, Conversely, the 
subsample from Alameda analyzed in this section was composed only partly of new JOBS mandatories; 
unlike the supplementary samples from Riverside and Tulare, the Alameda subsample analyzed in this 
section also contained pre-JOBS mandatories who had children under age 6, In other words, for 
Alameda only, the "supplementary" sample was actually part of the "main" sample. (See Chapter 1.) 

The few prior random assignment studies including samples of single parents with preschool 
children showed mixed results.'*^ The results for GAIN suggest that local operators who can run pro- 
grams that achieve impacts for other groups can also run programs that achieve impacts f ■ ' the new 
JOBS mandatory group. Large and statistically significant impacts on earnings and AFDC were found 
in Riverside, which also had large impacts for its main sample. Alameda showed somewhat lower 
earnings impacts, which were not statistically significant, and also showed AFDC impacts that were 
below the GAIN average. Tulare did not produce earnings impacts or AFDC impacts for this group 
in the first two years and, unlike the main Tulare sample, did not show impacts emerging in year 3, 
either. In fact, AFDC impacts in Tulare were in the wrong direction, with a higher percentage of 
experimentals than controls receiving AFDC (statistically significant in year 1) and higher average 
AFDC payments for experimentals as well (also statistically significant in year 1)."^-^ 



'^^One such study was the experimental evaluation of the Arkansas WORK program. That program 
operated prior to JOBS but had obtained a federal waiver to classify mothers with children aged 3 to 5 as 
mandatory. Impact results for that subgroup may be found in Friedlander et al., 1985, More recently, the 
evaluation of Florida's Project Independence provided impact estimates for a large sample of new JOBS 
mandatories. See Kemple and Haimson, 1994. 

'^^The impacts for Alameda in Table 4.12 were tested against those of the balance of the sample for that 
county. None of the differences in impacts between the two groups was statistically significant. The impacts 
for Riverside and Tulare were tested against those of the main analysis samples for those counties. Only two 
of the outcomes showed statistically significant differences (at the 10 percent level or better): "total 
employment" over three years for Riverside, and "ever received any AFDC payments" in the last quarter of 
year 1 for Tulare. 
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CHAPTERS 



GAINES EFFECTS ON JOB QUALITY. QUALITY OF LIFE. AND 
EMPLOYMENT DYNAMICS 



The previous chapter presented findings on the impacts of GAIN on AFDC-FG registrants' 
employment, earnings, and welfare receipt. One finding was the fact that, in Riverside and San 
Diego, experimentals were more likely to work as a result of the GAIN program but that the jobs they 
held paid about as much, on average, as the jobs held by controls; in Alameda and Butte, on the other 
hand, a greater part of the earnings gains was due to experimentals who entered better-paying jobs 
rather than large effects on the rate of employment. These data suggest that different GAIN programs 
can produce earnings impacts through different processes. 

However, because the analysis in Chapter 4 was based on quarterly Unemployment Insurance 
(UI) earnings data, it could not identify the actual number of hours worked per week or the actual 
weekly (or hourly) wage rates which, when combined, produced the earnings gains in different 
communities. Consequently, Chapter 4 could not answer such questions as: Did GAIN increase the 
likelihood that experimentals would find part-time jobs or full-time jobs? Better-paying jobs? Jobs 
that provided health and other fringe benefits? This chapter will use data from the registrant survey 
to address these kinds of questions. In doing so, it will help to explicate some of the processes 
through which GAIN programs in different counties produced the impacts on earnings that were 
discussed in Chapter 4. 

This chapter also examines measures of quality of life such as physical health and standard of 
living, which broaden the examination of GAIN'S impacts. Finally, the chapter will examine 
incentives to work that may affect the employment behavior of welfare recipients. 

The analysis focuses on AFDC-FG registrants in four counties: Alameda, Riverside, San Diego 
and Tulare. As was discussed in Chapter 1, because of a response bias problem, survey data from Los 
Angeles are presented only for experimentals (and are not included in the all-county averages). It 
should also be remembered that the follow-up period for the registrant survey spanned only two to 
three years after orientation, so that the reported results may not fully capture longer-term 
consequences. 

I. Job Characteristics Among Employed Experimentals and Employed Controls 

Tables 5. 1 and 5.2 use survr y data to examine the most recent jobs of AFDC-FG experimentals 
and controls who were employed. Since all experimentals are not being compared to all controls, these 
tables cannot provide a true measure of the "impact" of GAIN. This is because the personal 
characteristics of employed experimentals (or controls) were not necessarily the same as those of the 
experimental (or control) group as a whole. In other words, the similarity of the experimental and 
control groups (assured by the random assignment process that created them), which is essential to 
reliably determining impacts, cannot be assured when one is examining just those in each group who 
were employed. While Tables 5,1 and 5.2 therefore need to be interpreted cautiously, they can 
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TABLE 5.1 



AVERAGE HOURS AND WAGES OF MOST RECENT JOB AMONG AFDC-FG REGISTRANTS WHO 
REPORTED BEING EMPLOYED WITHIN TWO TO THREE YEARS AFTER ORIENTATION 



Outcome and 
Research Group 



' Los 

Alameda Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Average number of hours 
usually worked per week 

Employed experimentals 

Employed controls 

Percentage distribution of number 
of hours worked per week among 
employed experimentals (%) 

Less than 10 hours 

10-19 hours 

20-29 hours 

30-39 hours 

40 hours or more 



30,0 
26.7 



27 
18.8 
19.6 
17.9 
41.1 



27.8 



4.2 
23.9 
22.5 
14.1 
35.2 



32.1 
32.4 



5.5 
12.8 
17.4 
16.4 
47.9 



33.0 
31.0 



3.8 
9.0 
21.7 
17.9 
47.6 



35.1 
33.7 



5.6 
7.1 
15.2 
15.2 
56.9 



32.5 
30.9 



4.4 
11.9 
18.5 
16.8 
48.4 



Percentage distribution of number 
of hours worked per week am.ong 
employed controls (%) 

Less than 10 hours 

10-19 hours 

20-29 hours 

30-39 hours 

40 hours or more 



14.5 
16.4 
14.5 
22.7 
31.8 



6.1 

12.7 
17.6 
19.4 
44.2 



9.0 
13.0 
18.1 
13.0 
46.9 



6.7 
9.3 
12.9 
15.5 
55.7 



9.1 
12.9 
15.8 
17.7 
44.7 



Average earnings per week (c) ($) 
Employed experimentals 
Employed controls 

Percentage distribution of average 
earnings per week among 
employed experimentals (c) (%) 

$100 or less 

$101 -$200 

$201 '-$300 

$301 -$400 

$401 -$500 

More than $500 



209 
167 



28.6 
27.7 
23.2 
8.0 
6.3 
6,3 



172 



36.6 
32.4 
14.1 
9.9 
1.4 
5.6 



191 
206 



26.8 
37.3 
19.5 
10.7 
2.1 
3.6 



223 
188 



23.9 
31.9 
18.3 
13.1 
5.2 
7.5 



194 
200 



22.2 
35.4 
23.7 
11.1 
2.0 
5.6 



204 
190 



25.4 
33.1 
21.2 
10.7 
3.9 
5.8 



Percentage distribution of average 
earnings per week amdng 
employed controls (c) (%) 

$100 or less 

$101 -$200 

$201 -$300 

$301 -$400 

$401 -$500 

More than $bOO 



37.3 
27.3 
25.5 
6.4 
3.6 
0.0 



22.4 
40.0 
17.6 
9.1 
4.8 
6.1 



28.8 
29.4 
22.6 
10.2 
4.0 
5.1 



21.0 
37.4 
27.7 
7.7 
1.5 
4.6 



27.4 
33.5 
23.4 
8.4 
3.5 
3.9 
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TABLE 5.1 (continued) 



Outcome and 




Los 








All 


Research Group 


Alameda 


Angeles (a) 


Riverside 


San Diego 


Tulare 


Counties (b) 


Average earnings per hour (c) ($) 














Employed experimentals 


6.56 


6.06 


5.78 


6.23 


5.47 


6.01 


Employed controls 


6.09 


— 


6.14 


5.98 


5.81 


6.01 


Percentage distribution of average 














earnings per hour among 














employed experimentals (c) (%) 














$4.25 or less 


22.0 


27.1 


25 2 


22.7 


29.3 


24.8 


$4.26-$5.00 


19.3 


15.7 


26.0 


17.9 


24.6 


22.0 


$5.01 -$6.00 


11.9 


15.7 


14.7 


12.6 


17.3 


14.1 


$6.01 -$7.00 


10.1 


20.0 


10.4 


14.5 


11.5 


11.6 


$7.01 -$10.00 


19.3 


12.9 


16.8 


21 .3 


13.6 


17.8 


More than $10.00 


17.4 


8.6 


6.8 


11.1 ■ 


3.7 


9.8 


Percentage distribution of average 














earnings per hour among 














employed controls (c) (%) 














$4.25 or less 


19.1 




23.5 


25.6 


22.9 


22.8 


$4.26 -$5.00 


17.3 




27.2 


19.8 


27.6 


23.0 


$5.01 -$6.00 


19.1 




13.0 


14.5 


20.3 


16.7 


$6.01 -$7.00 


16.4 




6.8 


11.6 


8.3 


10.8 


$7.01 -$10.00 


20.0 




18.5 


21.5 


15.1 


18.8 


More than $10.00 


8.2 




11.1 


7.0 


5.7 


8.0 


Sample size 














Employed experimentals 


114 


71 


478 


214 


199 


1076 


Employed controls 


110 




- ^5 


178 


195 


648 



SOURCE: MDRC calculations using data from the GAIN registrant sun/ey. 



NOTES: Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

Tests of statistical significance of the differences between employed experimentals and employed controls were 
not performed, because such comparisons are non -experimental. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where the 
registrant survey was conducted. Butte County was not included in the survey. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, no estimates for controls are presented in this table for Los Angeles. 

(b) In the all -county averages, the results of each county (excluding Los Angeles) are weighted equally. 

(c) Most respondents reported gross (i.e., pre-tax) earnings. However, a sizable minority (roughly 20 percent) 
reported net (i.e., post-tax) earnings. No adjustment was made for those reporting post-tax earnings. Therefore, the results 
presented in this table somewhat underestimate the percentage of respondents with gross weekly earnings in exces3 of a 
given level. 
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TABLE 5.2 



NON-WAGE CHARACTERISTICS OF MOST RECENT JOB AMONG AFDC-FG REGISTRANTS 
WHO REPORTED EVER BEING EMPLOYED WITHIN TWO TO THREE YEARS 
AFTER GAIN ORIENTATION 



Outcome and 
Research Group 



Los 

Alameda Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Number of hours worked 
per week changed "a lof 
or "a fair amount' 

Employed experimentals (%) 

Employed controls (%) 

Employed experimentals (%) 
Job provided: 
Paid sick days 
Paid vacation days 
Health benefits 
Dental benefits 
Tuition assistance or 
paid training classes 

Employed controls (%) 
Job provided: 
Paid sick days 
Paid vacation days 
Health benefits 
Dental benefits 
Tuition assistance or 
paid training classes 

Federal, state, or local 
government job 

Employed experimentals (%) 

Employed controls (%) 

Seasonal job 
Employed experimentals (%) 
Employed controls (%) 

Percent who strongly agreed 
(answered 7~10ona0-10 scale) 
with the following statements: 

"The job security was good" 
Employed experimentals (%) 
Employed controls (%) 

'The job had good opportunities 
for promotion or advancement* 

Employed experimentals (%) 

Employed controls (%) 

"The people there taught you new 
things that would be valuable for 
doing your job better*' 

Employed experimentals (%) 

Employed controls (%) 



19.3 
24.8 



33.0 
34.5 
26.8 
29.5 

20.9 



22.9 
24.8 
24.8 
22.7 

7.4 



22.9 
20.6 



21.1 
23.9 



63.6 
48.6 



39.1 
27.4 



62.2 
45.9 



15.5 



23.9 
23.9 
25.4 
19.7 

10.0 



33.8 



15.5 



38.0 



28.2 



23.5 
20.6 



26.8 
37.4 
27.7 
23.7 

16.7 



22.7 
29.7 
26.9 
22.7 

14.5 



16.4 
10.7 



12.8 
17.2 



42.3 



54.3 
50.0 



34.8 
33.3 



53.6 
53.0 



28.9 
20.9 



32.4 
39.2 
32.7 
25.4 

17.6 



30.5 
35.3 
25.6 
20.1 

18.4 



20.9 
17.2 



14.0 
19.9 



51.0 
55.7 



36.1 
33.3 



55.3 
54.0 



23.0 
30.8 



23.1 
25.3 
22.7 
17.7 

13.5 



20.2 
29.2 
21 .4 
16.6 

10.4 



17.2 
12.0 



26.4 
30.9 



50.0 
52.6 



35.2 
30.8 



54.6 
53.1 



23.7 
24.3 



28.8 
34.1 
27.5 
24.1 

17.2 



24.1 
29.8 
24.7 
20.5 

12.7 



19.4 
15.1 



18.6 
23.0 



54.7 
51.7 



36.3 
31.2 



56.4 
51.5 
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TABLE 5.2 (continued) 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



"The skills you were learning 
would be valuable for getting 
a better job" 
Employed experimentals (%) 
Employed controls (%) 

Percent who reported high job 
satisfaction (answered 7-10 on a 
0-10 scale) 

Employed experimentals (%) 

Employed controls (%) 



66.4 
53.2 



65.2 
55.1 



53.5 



56.3 



52.9 
47.9 



57.4 
52.8 



58.7 
56.0 



58.2 
62.7 



52.8 
49.7 



61.1 
61.5 



57.7 
51 .7 



60.5 
58.0 



Sample size 
Employed experimentals 
Employed controls 



114 
110 



71 



478 
165 



214 
178 



199 
195 



1076 
648 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies in calculating sums and averages. 

Tests of statistical significance of the differences between employed experimentals and emp'oyed controls were not 
perfomied, because such comparisons are non-experimental. 

The foltow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

(a) An analysis of response patterns to the survey In Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, no estimates for controls are presented in this table for Los Angeles. 

(b) In the all-county averages, the results for each county (excluding Los Angeles) are weighted equally. 
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describe the kinds of jobs registrants were getting and whether experimentals who worked were getting 
the same, better, or worse jobs than controls who worked. 

Looking first at Riverside, Table 5.1 presents data on respondents' hours of employment. 
Employed experimentals worked an average of 32 hours at their most recent job, while employed 
controls worked an average of 32 hours; the distribution of hours of work was nearly identical for the 
two groups. In terms of income. Table 5.1 shows that employed experimentals actually earned less 
per hour at their most recent job than employed controls. The difference was 36 cents an hour, a 6 
\;ercent reduction in hourly wages compared to the employed controls ($5.78 versus $6.14). (In both 
Alameda and San Diego, there were small wage differences in the opposite direction.) The 
distributions of hourly and weekly wages presented in Table 5.1 show that a lower percentage of 
Riverside's employed experimentals, compared to employed controls, held recent jobs paying more 
than $7 an hour or more than $400 a week. 

This pattern in Riverside may have occurred because, when many more welfare recipients are 
going to work, people with more marginal job skills and credentials may be entering the labor market, 
and because of these characteristics they can be expected to command lower wages. Thus, Riverside's 
very success in increasing the proportion of experimentals who ever worked (which was documented 
in Chapter 4) may have lowered the wage levels of its employed experimentals compared to employed 
controls — although, as Table 5.1 indicates, the effect was not dramatic. 

Finally, the differences between employed experimentals and controls in Riverside on the five 
types of job benefits presented in Table 5.2 were generally small. For example, 28 percent of workers 
in the experimental group and 27 percent of workers in the control group received health benefits on 
their most recent job. Nor were there substantial differences when registrants rated their most recent 
jobs on five characteristics such as job security and advancement opportunities. 

In sum, on measures that can be construed as indicating the "quality" or the "desirability" of 
the respondent's most recent job — including the number of hours of employment, the earnings per 
hour and per week, the reported employee benefits, and the respondent's opinion of her job - there 
appears to have been little difference between the jobs secured by Riverside experimentals and those 
secured by workers in the control group, except for the somewhat lower wage levels among 
experimentals. 

A different pattern was found for Alameda. Table 5.1 shows that employed experimentals 
worked an average of about 30 hours per week on their most recent job (an increase of 3 hours, or 
12 percent, in working time). Fewer employed experimentals worked less than 10 hours a week and 
more experimentals worked 40 hours a week or more. Employed experimentals also had higher weekly 
earnings than controls - an average of $209 versus $167, or $42 more a week (an increase of 25 
percent compared to the weekly earnings of controls). While 21 percent of Alameda's employed 
experimentals earned more than $300 a week and 37 percent earned more than $7 an hour, among he 
controls these figures were 10 percent and 28 percent, respectively. Moreover, the difference in the 
proportion of employed experimentals and employed controls earning $400 per week or more was 
particularly large in Alameda (13 percent versus 4 percent). Finally, Table 5.2 shows that Alameda's 
employed experimentals were more likely to have received four of the five types of employee benefits, 
and there v/ere differences of 10 percentage points or more on each of the five items that asked 



respondents to rate their jobs. There was not a single difference of comparable magnitude on these 
items in any of the other counties. 

Since a relatively small proportion of respondents in Alameda ever worked, the sample sizes 
are low when just those recipients who got jobs are examined. Nevertheless, there were consistent 
differences on nearly all of the measures of job characteristics. It appears that Alameda experimental 
were able to secure more desirable jobs when they entered the labor market than controls who worked. 
However, it is important to remember that Alameda produced a relatively modest effect on 
experimentals' rate of employment (as documented in Chapter 4). Therefore, as the next section will 
illustrate, Alameda's impacts on the overall likelihood of experimentals' obtaining more desirable jobs 
were not substantial, and, in fact, were lower than Riverside's. 

In San Diego, there were some differences between employed experimentals and employed 
controls in average hours worked, hourly and weekly wages, and the receipt of health benefits. There 
were smaller differences between employed experimentals and employed controls in Tulare. 

To summarize: In Riverside, San Diego and Tulare, experimentals who worked were generally 
getting the same kinds of jobs as controls, with some small differences. In contrast, in Alameda, nearly 
all of the measures of the desirability of jobs show that experimentals who worked were getting 
somewhat "better" jobs than controls who worked. 

11. GAINES Impact on Job Quality 

Whereas Tables 5.1 and 5.2 presented the characteristics of the most recent job held by 
experimentals and controls who said that they had worked during the survey follow-up period. Table 
5.3 focuses on all experimentals and all controls. It shows the percentage of experimentals and 
controls who worked at a job of a specified type (based on the characteristics of the most recent job). 
This makes it possible determine GAIN'S impact on experimental's likelihood of getting a job of a 
certain type, compared to what their chances of obtaining such a job would have been in the absence 
of the program. Three sunmiary measures of respondents' most recent job are used: whether the job 
was full time (i.e., at least 30 hours a week) or part time, whether the respondent earned more or less 
than $200 a week, and whether or not the job provided health benefits. The table also presents 
differences in the rates of employment. Appendix Table F.l presents a variety of other measures of 
job quality for the two research groups. 

Lxx)king at Riverside, GAIN had a large effect on self-reported employment, with 71 percent 
of the experimentals and 48 percent of the controls saying tliat they had ever Ix^en employed during 
the survey follow-up period, a difference of 23 percentage points.^ Table 5.3 also shows that GAIN 



^This impact differs from the estimate presented in Chapter 4, which showed that, according to the 
Unemployment Insurance earnings records, Riverside's three-year impact on the rate of employment was 14 
percentage points. An earlier report showed that, over a two-year follow-up period (which more closely 
paralleled the survey period in Riverside), the impact on employment was 17 percentage points. For a variety 
of reasons, it is not unusual for survey data and administrative records to produce different findings on 
employment effects. For example, some jobs are not covered by the Unemployment Insurance system. For 
further discussion of this issue, see Orr et al., 1994. 



TABLE 5-3 



GAIN'S IMPACTS ON THE PERCENTAGE OF AFDC-FG REGISTRANTS WHO REPORTED BEING EMPLOYED 
WITHIN TWO TO THREE YEARS AFTER ORIENTATION AND THE PERCENTAGE MOST RECENTLY 
EMPLOYED AT A JOB WITH SELECTED CHARACTERISTICS 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Impact on the rate of employment 



Ever employed during the 
follow-up period, self-reported 

Experimental (%) 

Controls (%) 

Difference 



33.5 (c) 
32.1 
1.4 



31 .8 



70.9 
48.3 
22.7 *** 



64.1 
52.3 
11.8 *** 



55.2 
54.5 
0.7 



55.9 
46.8 
9.1 (d) 



Impact on the number of hours 
worked per week at most recent job 

Ever employed during the follow-up 
period and most recent job provided 
at least 30 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 

Ever employed during the folfow-up 
period and most recent job provided 
less than 30 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



19.2 15.7 45.4 
17.8 — 30.8 
1.4 14.6 * 



13.9 16.1 25.4 

14.3 — 17.4 

-0.4 — 8.0 *** 



41.4 39.4 36.3 

31 .8 38.8 29.8 

9.5 *** 0.6 6.5 (d) 



22.6 15.6 19.4 

20.4 15.4 16.9 

2.2 0.1 2.5 (d) 



Impact on weekly earnings 

Ever employed during the follow-up 
period and most recent job paid 
more than $200 per week (e) 

Experimentals (%) 

Controls (%) 

Difference 

Ever employed during the follow-up 
period and most recent job paid 
less than $200 per week (e) 

Experimentals (%) 

Controls (%) 

Difference 



16.4 10.8 29.2 

13.0 20.5 

3.4 — 8.7 *** 



16.7 21.1 41.6 

19.1 27.6 

-2.4 14.0 *** 



31 .5 24.7 25.5 

23.7 27.7 21 .2 

7.8 ** -3.0 4.2 (d) 



32.6 30.4 30.3 

28.6 26.8 25.5 

4.0 3.6 4.8 (d) 
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TABLE 5.3 (continued) 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare All Counties 



Impact on provision 
of health benefits 

Ever employed during the follov\/-up 
period and most recent job provided 
health benefits 

Experimentais (%) 

Controls (%) 

Difference 

Ever employed during the foltow-up 
period and most recent job did not 
provide health benefits 

Experimentais (%) 

Controls (%) 

Difference 



8.9 
7.9 
1.0 



24.1 
24.1 
0.1 



8.1 



23.8 



19.4 
12.6 
6.7 *** 



50.6 
34.2 
16.4 *** 



20.7 
13.4 
7.3 ** 



43.2 
38.6 
4.5 



11.8 
12.2 
-0.3 



42.7 
41.9 
0.9 



15.2 
11.5 
3.7 (d) 



40.2 
34.7 
5.5 (d) 



Sample size 

Experimentais 335 223 674 337 356 1925 
Controls 348 342 336 363 1389 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 



NOTES: Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

A two -tailed t-test was applied to the differences between the experimental and control groups in each county. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

The foltow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments during 
the foltow-up period of controls who responded to the survey differed markedly from those of controls who did not respond to the 
survey. For this reason, no estimates for controls and no impacts are presented in this table for Los Angeles. 

(b) In the all-county averages, the results of each county (excluding Los Angeles) are weighted equally. 

(c) In Alameda, employment rates were substantially underreported on the registrant survey, according to a comparison 
with the "ever employed" rate indicated by automated records data through quarter 9 for the same sample of survey respondents. 
Those records data show that 42 percent of experimentais and 36 percent of controls had been employed, for an impact of 

6 percentage points. 

(d) Tests of statistical significance of the experimental-control difference for all counties combined were not performed. 

(e) Most respondents reported gross (i.e., pre-tax) earnings. However, a sizable minority (roughly 20 percent) reported 
net (i.e., post-tax) earnings. No adjustment was made tor those reporting post -tax earnings. Therefore, the estimates presented 
in this table somewhat underestimate the percentage of respondents with gross weekly earnings in excess of a given level. 
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had statistically significant effects on obtaining both full-time and part-time jobs, as indicated by the 
characteristics of the most recent job obtained. In other words, experimental had a higher probability 
of working at a full-time job than they would have had in the absence of GAIN; however, they also 
had a higher probability of working at a part-time job. The observed effect of GAIN on obtaining a 
full-time job (an experimental-control difference of 15 percentage points)^ was somewhat larger than 
its effect on obtaining a part-time job (an experimental-control difference of 8 percentage points).^ 
Similar comparisons can be made for the other job characteristics listed in Table 5.3. The effect of 
GAIN in Riverside was greater on getting a lower-paying job (a 14 percentage point difference) than 
on getting one that paid more than $200 a week (an 8.7 percentage point difference), and GAIN had 
a substantially greater effect on securing a job that did not provide health benefits (a 16 percentage 
point difference) than on securing one that did (a 6.7 percentage point difference). These patterns 
simply reflect the fact that in Riverside experimental and controls who were employed got jobs that, 
more often than not, paid less than $200 a week and offered no health benefits; however, more of the 
experimental got jobs. 

In San Diego, there was a 12 percentage point difference in self-reported employment between 
experimental and controls over the follow-up period. This difference was greater for full-time rather 
than part-time jobs, for higher-paying rather than lower-paying jobs, and for jobs that provided health 
benefits. Thus, while GAIN produced a smaller increase in the rate of employment in San Diego than 
in Riverside, more of this employment was in jobs that had desirable characteristics. 

Table 5.3 shows that, in Alameda and Tulare, there were no statistically significant differences 
in ever being employed during the follow-up period (based, like all the survey data, on self-report). 
In Tulare, a longer follow-up period would probably have shown a different result because, as Chapter 
4 indicated, Tulare began to produce significant effects on employment and earnings for AFDC-FGs 
only in the third year after orientation. 

In Alameda, the results presented in Chapter 4 showed an increase in the experimental group's 
rate of employment of 8 percentage points over the three-year follow-up period. It is likely that 
employment in Alameda was under-reported by experimentals on the survey."^ Another problem in 



^Appendix Table F.l shows that, for a 40-hour-a- week job, the effect of GAIN is only diminished to 12 
percentage points. Appendix Table F. 1 also presents a different type of variable pertaining to part-time work. 
It divides respondents into three groups, based on their work patterns: those whose jobs during the follow-up 
period were all fall time (more than 30 hours a week), those whose jobs were all part time, and those who 
had been employed at both fall-time and part-time jobs. Experimentals in both Riverside and Sau Diego were 
significandy more likely than controls to have had full-time or a combination of full-time and part-time jobs; 
they were no more likely than controls to have worked just part time. This suggests that, in those counties, 
GAIN may have had its impact on employment and earnings by increasing experimentals' chances of obtaining 
full-time work. However, evidence is not yet available on the sequence of jobs or on how long respondents 
spent in different types of jobs, so this evidence should not be viewed as conclusive. 

■'a test of the statistical significance of the difference between the impact on obtaining a full-time versus 
the impact on obtaining a part-time job was not computed. 

"^e Unemployment Insurance employment records used in Chapter 4 show that 49 percent of Alameda's 
experimentals and 41 percent of its controls had v/orked over the three-year follow-up period, producing the 
impact of 8 percentage points. An earlier report showed that, over two years of follow-up (which more 
closely paralleled the sur\'ey period in Alameda), 42 percent of experimentals had worked compared to 35 
percent of controls, yielding an impact of 7 percentage points (Friedlander, Riccio, and Freedman» 1993). 
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Alameda is that the rate of employment for all recipients was low compared to that of other counties 
(except Los Angeles). This makes it more difficult to detect, for the full sample, the differences in 
job quality that were noted above among the relatively few recipients who worked. While Table 5.3 
showed no statistically significant differences for Alameda, Appendix Table F.l does show two such 
differences: Fewer Alameda experimentals were working at their most recent job for less than 10 hours 
a week (0.8 percent versus 4.7 percent for controls), and more experimentals were earning above $300 
a week (7.6 percent versus 4.7 percent for controls). 

It is difficult to connect specific characteristics of a county's GAIN program with its impacts 
on employment and earnings. Nevertheless, a comparison of the findings from Riverside and Alameda 
is suggestive. The strategy of encouraging quick entry into the labor market in Riverside (discussed 
in Chapter 2) appears to have been associated with high rates of employment but no differences in the 
types of jobs obtained by experimentals and controls who worked. At the other end of the spectrum, 
the data show that, on a variety of measures, employed experimentals entered higher-quality jobs than 
employed controls in Alameda. In addition, at least some experimental-control comparisons - 
particularly the percentage of registrants earning above $300 - support this finding, as does the 
analysis in Chapter 4. The GAIN strategy in Alameda emphasized occupational skills training. While 
this may have produced only small effects on rates of employment, it also seems to have enabled at 
least some Alameda experimentals to enter jobs with more desirable characteristics. 



III. GAINES Impact on Quality of Life Measures 

A second focus of this chapter is the larger effects of GAIN on survey respondents' quality of 
life. In counties where GAIN helped registiants enter the job market, did the chance to work affect 
their lives positively? Or did the strains of working affect them negatively? The following analysis 
shows that, even in counties where GAIN was having its greatest effect on employment, there was 
scant evidence of any effect on other aspects of these recipients' lives. 

Table 5.4 shows that, across all four counties, about 16 percent of AFDC-FG experimentals 
were currently married and living with their husbands at the time of the survey and about 10 percent 
had given birth during the follow-up period. There were no statistically significant differences between 
experimentals and controls on these variables in any of the counties. 

In Riverside, 27 percent of experimentals but only 18 percent of controls reported not having 
had public or private health insurance in the month prior to the survey. Although Table 5.2 showed 
that Riverside experimentals were slightly more likely than controls to have received health benefits 
on their most recent job, by the end of the survey follow-up period, fewer experimentals had access 
to health care. 

In Riverside, 3 percent of experimentals but only 1.2 percent of controls received Supplemental 
Security Income (SSI). There were also statistically significant differences in both Alameda and San 
Diego, but these differences were in the opposite direction, with fewer experimentals receiving SSI. 

Across all four counties, about 27 percent of experimentals lived in public housing or received 
government rent subsidies; 14 percent received assistance for heating or cooling costs in the month 
before the survey. The rates on these variables were almost exactly the same for controls. 
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TABLE 5.4 



GAIN'S IMPACTS ON SELECTED NON-MONETARY OUTCOMES FOR AFDG-FG REGISTRANTS 
WITHIN TWO TO THREE YEARS AFfER ORIENTATION 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Family status 



Currently married and living 

with spouse 

Experimentals (%) 6.9 

Controls (%) 5.3 

Difference 1 6 

Respondents who had given birth 

during the follow-up period 

Experimentals (%) 1 1 A 

Controls (%) 8.6 

Difference 2.8 



13.5 



5.6 



16.5 
17.4 
-0.9 



9.2 
9.7 
-0.5 



14.0 
15.8 
-1.7 



9.6 
7.4 
2.1 



24.7 
22.3 
2.4 



9.2 
8.2 
0.9 



15.5 
15.2 
0.4 (C) 



9.9 
8.5 

1.3 (c) 



Medical coverage and disability 
income in the month prior to the 
month of the survey interview 

Covered by (or with a spouse or 
child covered by) Medicaid 

Experimentals (%) 85.2 83.8 64.3 71.0 77.9 74.6 

Controls (%) 87.0 — 69.9 79.1 72.6 77.1 

Difference -1.8 — -5.6* -8.1** 5.3 -2.5(c) 

Not personally covered by 
Medicaid or other health 
insurance 

Experimentals (%) 11.4 11.7 27.0 17.5 17.6 18.4 

Controls (%) 8.3 ~ 18.4 15.7 20.6 15.7 

Difference 3.1 ~ 8.6*** 1.7 -3.0 2.6 :c) 

A child living with the respondent 
not covered by Medicaid or other 
health insurance 

Experimentals (%) 10.7 22.9 21.3 14.6 13.8 15.1 

Controls (%) 8.9 ~ 17.5 12.8 18.3 14.4 

Difference 1 .8 — 3.8 1 7 -4.5 0.7 (c) 

Received Supplemental 
Security Income (SSI) 

Experimentals (%) 2.3 5.4 3.0 0.1 4.7 2.5 

Controls (%) 4.7 1.2 1.9 4.5 3.1 

Difference -2.4* — 1.8* -1.9** 0.1 -0.6(c) 
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TABLE 5.4 (continued) 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Government housing 
and energy assistance (d) 

Currently living in public housing 
or receiving government rent 
subsidy (e.g.. "Section 8" housing 
assistance) 

Experimental (%) 

Controls (%) 

Difference 



46.5 
52.2 
-5.7 



33.6 



18.6 
18.5 
0.1 



25.7 
24.1 
1,7 



17.8 
15.5 
2.3 



27.2 
27.6 
-0.4 (c) 



Household received government 
assistance with heating or 
cooling costs in the month prior 
to the survey interview 

Experimentals (%) 

Controls (%) 

Difference 



19.4 
18.1 
1.3 



9.0 



10.8 
11.4 
-0.6 



10.0 
13.6 
-3.6 



14.8 
12.8 
1.9 



13.7 
14.0 
-0.2 (C) 



Sample size 
Experimentals 
Controls 



Physical health (e) 

Rated current physical health as 
"very good" or "excellent" 
compared to people of 
similar age 

Experimentals (%) 

Controls (%) 

Difference 



335 
348 



30.6 
29.1 
1.5 



223 



674 
342 



25.5 



33.9 
31.8 
2.1 



337 
336 



44.7 
37.9 
6.8 



356 

363 



30.5 
36.5 
-6.0 



1925 
1389 



34.9 
33.8 
1.1 (C) 



Overall material hardship 

Average number of material 
hardships reported on an index 
covering 8 hardships (f) 

Experimentals 

Controls 

Difference 



2.0 
1.9 
0.1 



1.9 



2.1 
2.0 
0.1 



1.7 

1.9 
-0.2 



2.2 
2.2 
0.0 



2.0 
2.0 
-0.0 (C) 



Sample size 
Experimentals 
Controls 



223 
228 



146 



447 

231 



223 

223 



237 
235 



1276 
917 



(continued) 
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TABLE 5.4 (continued) 



Outcome and Los All 
Research Group Al ameda Angeles (a) Riverside San Diego Tulare Counties (b) 

Perceptions of 
overall quality of life (d) 

Currently unhappy, sad, or 
depressed "very often" or "fairl\ 
often" 
Experimentals (%) 
Controls (%) 
Difference 

Currently "satisfied" or "very 
satisfied" with overall standard 
of living 
Experimentals (%) 
Controls (%) 
Difference 

Currently "satisfied" or 'Very 
satisfied" with life as a whole 
Experimentals (%) 
Controls (%) 
Difference 

Rate life as a whole "a little 
better^' or "much better than it 
was 2 years earlier 
Experimentals (%) 
Controls (%) 
Difference 

Sample size 
Experimentals 
Controls 

SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

A two-tailed t-test was applied to the differences between the experimental and control groups in each county. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

The foltow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. For this reason, no estimates for controls and no impacts are presented in this table for Los Angeles. 

(b) In the all-county averages, the results for each county (excluding Los Angeles) are weighted equally. 

(c) Tests of statistical significance of the experimental -control difference for all counties combined were not 

performed. 

(d) Less than 1 percent of survey respondents (experimentals and controls combined) did not respond to the 
specific items in this panel across the four counties. Nonresponders were not included in calculating the results presented. 

(e) Less than 3 percent of survey respondents (experimentals and controls combined) did not respond to the 
specific items in this panel across the four counties. Nonresponders were not included in calculating the results presented. 

(f) Using an index presented in Mayer and Jencks (1988). respondents were asked if they were experiencing 
any of eight specific types of material hardships relating to inadequate food, shelter, and medical coverage. 



40.3 40.0 37.5 
38.6 32.9 
1 .7 4.6 



44.5 51.7 52.3 

40.6 — 52.3 
3.9 -0.0 



52.9 54.5 56.6 
43.7 — 57.3 
9.3 * -0.7 



61.9 58.6 69.5 

58.0 62.9 

3.9 6.6 * 

223 145 460 

231 228 



36.8 35.8 37.6 

37.8 34.1 35.8 

-1.0 1.7 1.8 (c) 



56.5 57.9 52.8 

55.1 61.2 52.3 

1.4 -3.3 0.5 (c) 

54.7 63.7 56.9 

60.7 65.3 56.7 

-6.1 -1.7 0.2 (c) 



68.8 67.9 67.0 

69.4 68.9 64.8 

-0.7 -0.9 2.2 (C) 

230 244 1302 

231 250 940 
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Only one-third of respondents rated their physical health as ''very good" or "excellent" when 
compared to people their own age; these ratings did not vary significantly by research group in any 
of the counties. 

The survey collected data on eight indicators of material hardship including whether respondents 
had enough food, adequate housing, and access to health care. Respondents reported an average of 
two problems in these eight areas, with no significant differences by research group.^ 

Finally, respondents were asked to rate the quality of their lives. For example, were they 
"satisfied" or "very satisfied" with their overall standard of living? About 38 percent of experimentals 
saw tliemselves as currently unhappy, sad, or depressed, while between 53 and 67 percent answered 
each of the other items in a direction that indicated general satisfaction. In Riverside, more 
experimentals than controls saw their lives as better than two years earlier (70 percent versus 63 
percent). In Alameda, more experimentals were satisfied with "life as a whole now. " Apart from these 
two statistically significant findings, there was no noteworthy pattern of experimental-control group 
differences in any of the counties by the end of the survey follow-up period. 

In sum. Table 5.4 examined 14 non-monetary outcomes concerning living conditions and 
perceived quality of life. There were statistically significant differences on only 8 of 56 comparisons 
(4 of these 8 differences were in Riverside). Of course, a much wider range of indicators could be 
developed. At least for this selection of indicators, however, the evidence suggests that GAIN, no 
matter what its effect on employment, neither improved nor diminished the living conditions or quality 
of life of these respondents by the end of the two- to three-year survey follow-up period. 

Finally, Table 5.5 presents some preliminary evidence that the way a GAIN program is 
conducted may affect the attittides of recipients. The table examines three items about the preference 
for work or welfare: "Unless a job offers me medical benefits and more money than AFDC, I'd rather 
be on AFDC," "I would only take a full-time job if it paid more than $6 an hour and provided medical 
benefits," and "Even a low-paying job is better than being on welfare." 

In Riverside, there were statistically significant differences on the first and third items. 
Compared to the controls, experimentals less often "strongly agreed" with the first item and more often 
"strongly agreed" with the third item. In both cases, they were saying that it is better to work than to 
be on welfare. In contrast, in Alameda, there was a significant difference on the first item only, but 
it was in the opposite direction: More experimentals preferred to be on welfare unless they could get 
a job that paid more than $6 an hour and provided medical benefits. The differences on the second 
item were not statistically significant but were consistent with the overall patterns for Alameda and 
Riverside. 

While based on responses to only a few questions, the attitude changes in Riverside and 
Alameda parallel the emphases in their GAIN programs. Riverside's program strongly emphasized 
moving registrants quickly into jobs and encouraging them not to be very selective about the quality 
of their first job (see Chapter 2); its registrants moved in the direction of preferring work to welfare. 
In contrast, Alameda more strongly encouraged job skills training in the hope that registrants would 



^These items were taken from a scale used by researchers at Northwestern University to measure material 
hardship. See Mayer and Jencks, 1989. 
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TABLE 5.5 



GAIN'S IMPACTS ON AFDC-FG REGISTBANTS' ATKITUDES TOWARD WORK AND WELFARE 
AT THE TIME OF THE TWO- TO THREE- YEAR SURVEY INTERVIEW 



Outcome and Los All 
Research Group Alameda Angeles (a) Riverside San Diego Tulare Counties (b) 



Strongly agreed (answered 7-10ona0-10 
scale) that "Unless a job offers me medical 
benefits and more money than AFDC, 
I'd rather be on AFDC" 

Experimental (%) 

Controls (%) 

Difference 

Average score (on a 0-10 scale) for 
" Unless a job offers me medical benefits 
and more money than AFDC. 
I'd rather be on AFDC 

Experimentals (%) 

Controls (%) 

Difference 

Strongly agreed (answered 7-10 on a 0-10 
scale) that "1 would only take a full-time job 
rf it paid more than $6 an hour and provided 
medical benefits" 

Experimentals (%) 

Controls (%) 

Difference 

Average score (on a 0 - 1 0 scale) for 
"I would only take a full-time job if it 
paid more than $6 an hour and 
provided medical benefits" 

Experimentals (%) 

Controls (%) 

Difference 

Strongly agreed (answered 7-10 on a 0-10 
scale) that "Even a low-paying job is better 
than being on welfare" 

Experimentals (%) 

Controls (%) 

Difference 

Average score (on a 0-10 scale) for 
"Even a low-paying job is better 
than being on welfare" 

Experimentals (%) 

Controls (%) 

Difference 



46.6 40.6 26.6 
38.9 39.0 
7.7 ** -12.4 *** 



5.4 5.0 3.5 

4.7 4.5 

0.7 ** -1.0 *** 



73.6 57.3 47.3 

67.9 51.3 

5.7 -4.0 



7.6 6.4 5.4 

7.3 5.9 

0.3 -- -0.4 



33.3 40.2 52.3 

33.3 43.3 

0.1 -- 9.0 *** 



4.8 4.9 6.2 

4.7 5.6 

0.0 0.7 *** 



35.7 30.8 34.9 

34.9 31.6 36.1 

0.8 -0.8 -1.2(C) 



4.3 4.1 4.3 

4.4 3.8 4.3 
-0.1 0.3 -0.0 (C) 



56.3 48.1 56.3 

58.6 50.9 57.2 

-2.3 -2.9 -0.9 (c) 



6.2 5.7 6.2 

6.5 5.7 6.3 

-0.3 0.0 -0.1 (c) 



49.3 50.0 46.2 

43.5 52.4 43.1 

5.8 -2.4 3.1 (C) 



6.0 6.1 5.8 

5.6 6.1 5.5 

0.4 0.0 • 0.3 (c) 



Sample size 

Experimentals 335 223 674 337 356 1925 
Controls 348 :::: 342 336 363 1389 

(continued) 



TABLE 5.5 (continued) 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

A two-tailed t-test was applied to the differences between the experimental and control groups in e^ich county. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

Estimates are regression-adjusted using ordinary least squares, controlling for pre-random assignment background 
characteristics of the sample members. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where the 
registrant survey was conducted. Butte County was not included in the survey. 

Ninety-six percem of survey respondents (experimentals and controls combined) responded to the specific items in this 
table across the four counties. Nonresponders are not included in calculating the results presented. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments during 
the folbw-up period of controls who responded to the survey differed markedly frorn those of controls who did not respond to the 
survey. For this reason, no estimates for controls and no impacts are presented in this table for Los Angeles. 

(b) In the all-county averages, the results of each county (excluding Los Angeles) are weighted equally. 

(c) Tests of statistical significance of the experimental-control difference for all counties combined were not performed. 
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get "better" jobs; its registrants moved in the direction of preferring welfare unless they could secure 
a "better" job. Thus, welfare programs with strong and consistent messages may have the potential, 
as illustrated by these patterns of response, to affect recipients' perceptions about work and welfare. 



IV. Employment Behavior 

The analysis in this and previous chapters has focused on comparing experimental and controls. 
In contrast, this section explores some of the general processes that may affect the labor market 
behavior of all welfare recipients. It uses both quantitative data from the registrant survey and a 
qualitative analysis of open-ended responses on the survey to address three issues: (1) Why did a 
substantial group of respondents who found work quit their jobs? (2) Why were a substantial group 
of respondents at the time of the two- to three-year survey neither working nor looking for work? (3) 
What were the incentives for working, and were these incentives understood? 

A. Leaving Jobs 

Table 5.6 gives data for AFDC-FG employed experimentals and employed controls in all four 
counties combined. It shows that 43 percent of employed experimentals had left a job during the two- 
to three-year follow-up period. Asked why they had left their most recent job, 25 percent of those who 
left a job said that they had been laid off; 13 percent, that they had been fired; 21 percent, that the job 
had ended; and 41 percent, that they had quit. Table 5.6 also shows that there were generally similar 
experiences among employed controls. Why had such a substantial proportion of registrants quit jobs? 

Respondents were asked to specify the "main reason" they quit, and interviewers were asked 
to record their responses verbatim. In total, 223 responses were given to this open-ended item. These 
included responses from registrants who had quit either their most recent job or the job they held when 
they left welfare. Moreover, they included responses from experimentals and controls, AFDC-FGs 
and AFDC-Us, and respondents in Los Angeles. In order to work with a sizable sample, and because 
not all those who quit jobs responded to the open-ended item, all responses available from the survey 
are included in the following analysis. Therefore, the reasons for quitting reported below are not 
necessarily representative of the groups of AFDC-FG experimentals and controls that are the focus of 
other sections of this chapter. 

The most frequent reason for quitting was that th<& respondent had found better (usually higher- 
paying) work, which was true for 22 percent of the 223 respondents. Other respondents said that their 
job had been a poor one with low pay and no opportunities for advancement (8 percent), or involved 
unacceptable working hours or working conditions (4 percent). For example, one respondent talked 
of night work as "not being suitable for my family," while another felt that "graveyard hours" were 
jeopardizing her "rehabilitation." One worker left for a "job with benefits"; another said that "work 
had slowed down, I was not satisfied to be working just a few hours a week, and I quit to look for 
better work"; a third "couldn't carry all the plates on my arm"; and a store clerk who had been robbed 
at gunpoint at work was afraid to return. 

An additional 18 percent of respondents reported that tliey had quit jobs because of an 
interpersonal problem, usually with a boss or supervisor. For example. 
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TABLE 5.6 



REPORTED REASONS FOR LEAVING A JOB AMONG AFDC-FG REGISTRANTS WHO LEFT A JOB 
WITHIN TWO TO THREE YEARS AFTER GAIN ORIENTATION IN FOUR COUNTIES 
COMBINED. BY RESEARCH GROUP 

Sample and Employed Employed 
Outcom e Experlmentals Controls 

All employed respondents 

Percent who left a job during the 

follow-up period 42.8 42.1 

Sample size 1P05 , 648 

All employed respondents who left 
a fob during the follow -up period (a) 

Most recent reason for leaving a job (%) 

Laid off 25.1 17.5 

Fired 13.4 11.0 

Job ended 20.8 26.6 

Quit 40.8 44.9 

Sample size 430 273 

SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies in calculating sums and averages. 

The results in the table are based on data from Alameda, Riverside, San Diego, and Tulare Counties onlv . 
Butte County was not included in the survey. Furthermore, results from Los Angeles are excluded because an 
analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments during 
the follow-up period of controls who responded to the survey differed markedly from those of controls who did not 
respond to the survey. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties 
where the registrant survey was conducted. 

Tests of statistical significance of the differences in outcomes between the subsets of experimental and 
controls included in this table were not performed, because such corriparisons are non-experimental. 

(a) Response rates for this panel were 97.4 percent and 96.3 percent for experimental and controls, 
respectively. Nonresponders were not included in calculating the results presented. 
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"The manager was very lousy. They were rude and did not knc-v bow to treat 
individuals." 

"I had a big disagreement with the persons at the bingo place." 

"Management was abusing me. I was pregnant, and when I told them I could not lift 
heavy things, they yelled at me." 

"Sexual harassment." 

Included in this category are some who felt they had been cheated: 

"They were not paying me all my money. They were cheating me." 
"I left because they cheated me out of my vacation pay." 

Most of the remaining responses fell into two categories: 12 percent quit jobs because they had 
medical problems, and 19 percent quit because of transportation problems. In most instances, 
transportation problems did not occur because respondents had taken jobs so far away from their 
homes that they could not get to them, or because their means of transportation was unreliable. 
Usually such problems arose because the respondent had to move, owing to a changing family situation 
or a sick relative. 

Finally, a number of explanations for quitting work were noteworthy because of their very 
infrequency. These included: a desire not to work anymore (.004 percent of the open-ended 
responses), wanting to return to welfare to receive medical benefits (.004 percent), becoming pregnant 
(1 percent), planning to go to school (2 percent), having disagreements with spouses or mates because 
of work (3 percent), or having child care problems (4 percent). 

Thus, the reasons respondents gave for quitting jobs revolved around their seeking more suitable 
and better-paying employment, tensions they experienced at the workplace, changes in their family 
situations, and illnesses. An open-ended question tries to elicit the frame of reference of respondents. 
What is perhaps most notable about these answers is the absence of any questioning of the value of 
work or any endorsement of the view that welfare provides a better option than work. 

B. Remaining Out of the Labor Market 

Figure 5.1 gives the self-reported employment status of all AFDC-FG experimental group 
survey respondents in the four survey counties at the time they were interviewed. The figure shows 
that, for each 100 experimentals, 25 were working more than 20 hours a week, 8 were working less 
than 20 hours a week, and 27 were not working but were looking for work. Thus, two to three years 
after random assignment, niore than half the registrants were in the labor market. However, a 
substantial group of respondents - 40 - said that they were neither working nor looking for work. 
How did these individuals account for their labor market inactivity? 

Figure 5.1 presents the "most important reason" given by experimentals for not looking for 
work. In 28 percent of the cases, it was the respondent's own ill health or disability; in 2 percent, 
pregnancy; in 4 percent, a child's ill health or disability; and in 6 percent, other family responsibilities 
(often, the ill health or disability of a parent or partner). These categories account for 40 percent of 
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FIGURE 5.1 



SELF-REPORTED EMPLOYMENT STATUS AND REASONS FOR 
NOT LOOKING FOR WORK AMONG AFDC-FG EXPERIMENTAL SURVEY RESPONDENTS 
IN FOUR COUNTIES AT THE TIME OF THE TWO- TO THREE-YEAR INTERVIEW 



Ail Experimentals 
100 



Not working, but looking 






for a job: 


27 




• Looking for a part- 






time job: 


3 





• Looking for a full- 






time job: 


24 





Working more than 20 
hours per week: 25 



Working 20 hours per 




week or less: 


8 


• Looking for a full- 




time job: 


2 


• Not looking for a full- 




time job: 


6 



Not working and not looking for a part-time or full-time job: 


40 


Percentage of those 


Most important reason for not looking for a job: not looking 


• Wants to stay home with child 


10 


• Can't afford child care 


2 


• Cen't arrange child care 


2 


• Child's ill health, disability 


4 


• Family responsibilities, other than personal child care 


6 


• Own ill health, disability 


28 


• Pregnancy 


2 


• In school or training 


22 


• Does not want to work now 


1 


• Couldn't find work or believes no suitable work is available 


1 


• Lacks necessary experience 


5 


• Transportation problems 


4 


• Other 


14 


Total 


100 
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SOURCE AND NOTES: See Table 5.6. 

The results in this figure are based on data from Alameda, Riverside, San 

Diego, and Tulare. 
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the inactive recipients. Another 22 percent were attending school or training programs. A third 
category involves childrearing. Only 2 percent said ihat they were not looking for work because they 
could not afford child care, and only 2 percent cited the difficulty of arranging for child care. 
However, 10 percent said that they wanted to stay home with their children. Together, these responses 
account for 14 percent of those who were inactive in the labor market. Figure 5.2 presents similar data 
for controls. 

The only additional large category of responses in Figures 5.1 and 5,2 is represented by the 
group labeled "other." Their responses covered a wide range of life situations: Some were planning 
to enter school; some were in the process of moving; some were seasonal workers: some were 
homeless; and so forth. Very few indicated that they viewed welfai-e as a better option than work, 

C. Monetary Incentives to Work 

Respondents rarely indicated that it is not worthwhile for them to work, or that the pay they 
could command in the workplace was not a substantial enough inducement to work. However, this 
raises the question of whether there really were sufficient monetary incentives for participants in the 
GAIN evaluation to work or whether, as is frequently alleged, there was little or no incentive to work. 
In other words, did work pay? 

Table 5.7 gives examples of how much a California welfare recipient would have received in 
monthly income under the rules that were in effect in 1993. The table is based on four factors: 
earnings, AFDC grant levels. Food Stamp allotments, and the Earned Income Tax Credit (EITC), It 
does not include the value of Medi-Cal (Medicaid) eligibility, public housing, government housing 
subsidies, assistance for heating and cooling, or other entitlements. Nor does it take into account any 
of the costs of working such as the costs of transportation, child care, and additional clothing and food. 

The table assumes that the recipient was a single mother with two children, had a monthly rent 
of $500, and, if employed, had mc»nthly child care expenses of $200. If she was unemployed, her 
gross family income from AFDC and Food Stamps would have been $826 per month. 

If this recipient had been employed for 20 hours a week at $4.25 an hour, her income would 
have risen to $1,240 during the first 12 months of working and continued at that level. To put this 
differently, assuming 80 hours of woik a month, each hour of work would have increased the family's 
income above what they would have received from AFDC and Food Stamps by $5.18. 

If the recipient had been employed for 35 hours a week at $5 an hour, her income would have 
increased to $1,465 during the first four months of employment, $1,339 during months 5 through 12, 
and $1,318 after one year of work. It would have been primarily the earnings disregard that would 
have changed over these time periods. Assuming 140 hours of work per month, each hour of work 
would have increased the family's income above what it would have received from AFDC and Food 
Stamps by $4.56, $3.66, or $3.51, depending on the time period. 

In comparing this second hypothetical worker to the first, it is important to note that moving 
from a part-time, low-paying job to a full-time, low-paying job would have increased family income. 
However, this pertains primarily to months 1 through 4. After working for one year, the full-time 
worker would have been spending 60 more hours a month at work, but her total earnings would have 
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FIGURE 5.2 



SELF REPORTED EMPLOYMENT STATUS AND REASONS FOR 
NOT LOOKING FOR WORK AMONG AFDC FG CONTROL SURVEY RESPONDENTS 
IN FOUR COUNTIES AT THE TIME OF THE TWO- TO THREE-YEAR INTERVIEW 



All Controls 
100 



Not working, but looking 




for a job: 26 




• Looking for a part- 




time job: 3 




• Looking for a full- 




time job: 23 







Working more than 20 


► 


hours per week: 20 





Working 20 hours per 




week or less: 8 




• Looking for a full- 




time job: 2 




• Not looking for a full- 




time job: 6 



Not working and not looking for a part-time or full-time job: 


46 


Percentage of those 


Most important reason for not looking for a job: not looking 


• Wants to stay home with child 


13 


• Can't afford child care 


4 


• Can't arrange child care 


3 


• Child's ill health, disability 


2 


• Family responsibilities, other than personal child care 


6 


• Own ill health, disability 


30 


• Pregnancy 


1 


• In school or training 


14 


• Does not want to work now 


1 


• Couldn't find work or believes no suitable work is available 


3 


• Lacks necessary experience 


8 


• Transportation problems 


7 


• Other 


10 


Total 


100 



SOURCE AND NOTES: See Table 5.6. 

The results in this figure are based on data from Alameda, Riverside, San 

Diego, and Tulare. 
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TABLE 5,7 



HYPOTHETICAL EXAMPLES OF GROSS FAMILY INCOME PER MONTH FOR A SINGLE PARENT WITH 
TWO CHILDREN AT DIFFERENT LEVELS OF EARNINGS. UNDER WELFARE AND FEDERAL 
EARNED INCOME TAX CREDIT (EITC) RULES IN EFFECT IN EARLY 1993 



Monthly Income 

Hours Employed per Week AFDC Food 

and Hourly Wage Earnings ($) Grant ($) Stamps ($) EITC ($) (a) Total ($) 

First through fourth month 
of employment 



Not employed 


0 


624 


202 


0 


826 


Employed 20 hours per week 
at $4.25 per hour 


370 


624 


174 


72 


1240 


Employed 35 hours per week 
at $5.00 per hour 


763 


475 


101 


126 


1465 


Employed 40 hours per week 
at $7.00 per hour 


1220 


170 


74 


98 


1562 


riTin inrougn iweiiin monm 
of employment 












Not employed 


0 


624 


202 


0 


826 


Employed 20 hours per week 
at $4.25 per hour 


370 


624 


174 


72 


1240 


Employed 35 hours per week 
at $5.00 per hour 


763 


261 


189 


126 


1339 


Employed 40 hours per week 
at $7.00 per hour 


1220 


0 


150 


98 


1468 


After the twelfth month 
of employment 












Not employed 


0 


624 


202 


0 


826 


Employed 20 hours per week 
at $4.25 per hour 


370 


624 


174 


72 


1240 


Employed 35 hours per week 
at $5.00 per hour 


763 


231 


198 


126 


1318 


Employed 40 hours per week 
at $7.00 per hour 


1220 


0 


150 


98 


1468 



SOURCE: MDRC calculations using data from U.S. Congress, House Committee on Ways and Means, 1993, and U.S. Department 
of Treasury, Office of Tax Analysis, 1993. 



NOTES: Calculations assume monthly rent of $500 and monthly child care expenses of $200 for employed household heads. 

(a) Monthly income from EITC is based on the estimated annual EITC amount, divided by 1 2, for a family with a given 
level of earnings. 
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been only $78 a month more than those of the part-time worker. This suggests that a welfare recipient 
in this study who could find only a low-paying job had less economic incentive to work full-time than 
to work part-time after one year of work.^ 

Finally, assume that a recipient was employed for 40 hours a week at a job that paid $7 an 
hour. Her income would have been $1,562 during the first four months of working, $1,468 during 
months 5 through 12, and $1,468 after one year of work. Assuming 160 hours of work per month, 
each hour of work would have increased the family's income above AFDC and Food Stamps by $4.60 
in the first four months of work and $4.01 thereafter. Even though she was earning at a level that 
Table 5.1 showed few welfare recipients achieve, this ftiU-time worker would have been spending 80 
hours a month more at her job than the part-time worker and would have been earning $228 more after 
four months, an increase in earnings (compared to the earnings of the part-time worker) of 18 percent. 
Given the additional expenses required in order to work, it is not clear how much of an incentive there 
was to take these jobs rather than to work part-time. 

In sum, the monetaiy incentives to work, particularly to work ftiU-time, were very mixed for 
the welfare recipients in this study. Therefore, it is notable that Table 5,1 showed that 65 percent of 
experimental and 62 percent of controls who were working were doing so for 30 hours or more per 
week, and most of them for at least 40 hours a week. It is also notable that Figures 5.1 and 5.2 
showed that the vast majority of job-seekers (e.g,, 24 out of the 27 experimental who were not 
working but were looking for work) said that they were seeking full-time jobs. Given the limited 
incentives for ftiU-time work, these high rates of full-time work and work-seeking suggest that 
registrants may have been responding to strong noneconomic incentives to work, to high expectations 
about the fiiUire payoff of work, or to other factors. It is also possible that they did not fully 
understand the financial implications of working full-time, particularly because of the more generous 
incentives during the first four months of employment. Finally, despite the view of recipients that 
their employment behavior was being shaped by a set of situational contingencies, it may be that, over 
time, economic incentives to work full-time diminish in value, thereby increasing the probability that 
the recipient will return to welfare. 

Finally, Table 5.8 provides information on the Earned Income Tax Credit. For all counties 
combined, only 45 percent of experimentals and 41 percent of controls had ever heard of this 
incent've. Only one-third of those who had never worked during the survey follow-up period had 
heard of it. This table illustrates the fact that many welfare recipients may not understand the complex 
set of incentives summarized above. It also suggests that changing elements of this incentive system 
will have only limited effects unless programs can more effectively communicate these incentives to 
recipients. 



^In 1993, California took steps to strengthen the financial incentive to work, including the elimination of 
the time limitation on the 30 1/3 earnings disregard, increasing the resource allowance, and, for the heads of 
two-parent families, elimination of the "100-hour rule." 



TABLE 5.8 



GAIN'S IMPACT ON AFDC-FG REGISTRANTS' REPORTED AWARENESS AND USE OF THE 
FEDERAL EARNED INCOME TAX CREDIT (EITC) 



Outcome and 
Research Group 



Alameda 



All respondents 

Had heard of the EITC (c) 
Experlmentals (%) 
Contrcis (%) 
Difference 



41.2 
36.6 
4.6 



Los 

Angeies (a) 



21 .4 



Riverside San Diego 



Tulare 



All 

Counties (b) 



45.7 
38.8 
6.9 



48.4 
47.4 
1.0 



46.0 
42.1 
3.9 



45.3 
41.2 
4.1 



(d) 



Sample size 
Experimental 
Controls 



Respondents who worked 
within two to three years 
after orientation 

Had heard of the EITC 
Experimental (%) 
Controls (%) 

Sample size 
Experimental 
Controls 



Respondents who never 
worked within two to three 
years after orientation 

Had heard of the EITC 
Experimental (%) 
Controls (%) 

Sample size 
Experlmentals 
Controls 



335 
348 



57.1 
58.7 



114 
110 



32.4 
26.9 



221 
238 



223 



674 

342 



28.2 



71 



52.7 
49.7 



478 

165 



18.1 



152 



27.9 
29.5 



196 
177 



337 
336 



54.3 
55.7 



214 
178 



38.3 
37.7 



123 
158 



356 
363 



53.5 
51.3 



199 
195 



36.5 
30.9 



157 
168 



1925 
1389 



54.4 
53.8 



1076 
648 



33.8 
31.2 



849 
741 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

A two-tailed t-test was applied to the differences between the experimental and control groups in each county. 
Statistical significance levels are indicated as *** = 1 percent; = 5 percent; * = 10 percent. 

Tests of statistical significance of the differences between experlmentals and controls who worked during the 
follow-up period and between experimental and controls who did not work during the follow-up period were not 
performed because these comparisons are non-experimental. 

The follow-up period 'or the survey ranged from 26 to 37 months, on average, across the five counties where 
the registrant survey was conducted. Butte County was not included in the survey. 

From 97.3 percent to 99.2 percent of survey respondents (experimental and controls combined) responded to 
the specific items in this table across all subgroups. Nonrespondents were not included in calculating the results presented. 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments 
during the follow- up period of those controls who responded to the survey differed markedly from those of controls who 
did not respond to the survey. For this reason, no estimates for controls and no impacts are presented in this table for 

Los Angeles. 

(b) In the all-county averages, the results of each county (excluding Los Angeles) are weighted equally. 

(c) Estimates presented in this panel are regression-adjusted using ordinary least squares, controlling for pre-- 
random assignment background characteristics of the sample members. 

(d) Tests of statistical significance of the experimental -control difference for all counties combined were not 

perfomned. 
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CHAPTER 6 



THREE-YEAR IMPACTS FOR REGISTRANTS WHO WERE HEADS OF 
TWO^PARENT FAMILIES (AFDC-Us) 



Using Unemployment Insurance (UI), AFDC, and Food Stamp records in a manner parallel to 
Chapter 4's discussion of single-parent (AFDC-FG) registrants, this chapter presents the three-year 
impacts of GAIN on the employment and earnings, AFDC receipt and payments, and Food Stamp 
receipt and payments for heads of two-parent (AFDC-U) households. Its purpose is two-fold: first, 
to determine the size of GAIN'S impacts for the AFDC-U cases and, second, to see how the counties 
ranked in the magnitude of their impacts for AFDC-Us compared to those for AFDC-FGs. 

The discussion of methodological issues in Chapter 4 is not repeated here. It bears 
emphasizing, however, that impact estimates for very small samples have low reliability and will be 
flagged with the symbol "u** (for "unreliable") in the subgroup tablqs. Sample size considerations 
apply not only to subgroups but also to the full AFDC-U sample for Alameda, which was quite small 
and should not be weighted at all heavily in any assessment of the overall impacts of GAIN for 
AFDC-Us. Estimates for the full AFDC-U sample for Alameda are not included in the all-county 
average impact estimates. 



I. A Summary of the Findings on Earnings and Welfare Savings for AFDC-Us 

Averaging across five counties (omitting Alameda), and giving each county equal weight, yields 
three-year earnings gains of $1,111 per experimental group member and three-year AFDC impacts of 
$1,168 (a saving of 6.0 percent relative to the average AFDC payments to controls). These results 
are important because they show earnings effects for AFDC-Us, a group that has not been studied 
widely in evaluations of welfare-to-work programs.^ Consistent with the limited prior research, 
however, AFDC-Us showed a pattern of earnings impacts different from that for AFDC-FGs: The 
five-county average of earnings impacts for AFDC-Us did not increase from year 1 to year 2 or from 
year 2 to year 3. Experimentals in two-parent families earned, on average, $384 more than controls 
in year 1, $372 in year 2, and $355 in year 3.^ AFDC savings increased from $422 in year 1 to $469 
in year 2, but then declined to $277 in year 3. By year 3, the all-county average impacts on earnings 
and AFDC payments were larger for AFDC-FGs than for AFDC-Us. Thus, although the three-year 
total earnings and AFDC impacts were similar for AFDC-FGs and AFDC-Us, future additional 
impacts are li!;ely to be larger for AFDC-FGs. For AFDC-Us, reductions in Food Stamp benefits over 
the three-year follow-up totaled $222 for the five-county average (a 4.8 percent saving relative to the 
average amount for controls) - about one-fifdi the size of impacts on AFDC payments and larger than 
the Food Stamp impact for AFDC-FGs. The five-county average impact estimates were all statistically 
significant for earnings and for AFDC and Food Stamp payments. 

As was the case for AFDC-FGs, impacts for AFDC-Us varied considerably by county. GAIN 
increased earnings in the three-year follow-up period in four of the six research counties - Alame' a. 
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^For earlier results on AFDC-Us, see Gueron and Pauly, 1991. 

^Impact estimates for years 1 and 2 may differ slightiy from those presented in the two-year impact report 
(1993) because some earnings and AFDC records data were updated. 
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Butte, Los Angeles, and Riverside - although impacts for the small Alameda sample were not statisti- 
cally significant. Butte produced the largest earnings impact for AFDC-Us, an increase of $3,295 per 
experimental.^ Riverside had a substantial three-year impact on earnings: $1,506 per sample 
member. Impacts in Los Angeles ($887) and Alameda ($782) were smaller, although the sample size 
in Alameda was too small to allow confidence in the result. Relative to control group average earnings 
during the three-year follow-up period, the dollar impacts in tliese four counties represented increases 
of 15 to 39 percent. San Diego produced quite small gains ($134) over the three years, and Tulare 
showed no evidence of earnings impacts during the three-year observation period common to samples 
in all counties, or thereafter. 

Counties also differed in how the experimental-control earnings differential changed over time. 
In Butte, the county with the largest three-year earnings impacts for AFDC-Us, earnings impacts in- 
creased from year 1 to year 2 and then held steady from year 2 to year 3, although there was some 
evidence that these impacts might begin to fall in year 4. In Riverside, which had the largest initial 
earnings impact, the earnings impact had fallen by year 3 to less than half the first-year earnings 
impact. Only Alameda, with its small sample of AFDC-Us, showed a large increase in earnings 
impacts between years 2 and 3. Some additions to impacts may still occur in the future in Alameda, 
Butte, Los Angeles, and Riverside. 

Reductions in AFDC payments were found in four counties - Butte, Los Angeles, Riverside, 
and San Diego — although they were not statistically significant in Butte. In Los Angeles, Riverside, 
and San Diego, three-year welfare savings were larger than earnings gains. Riverside's welfare 
impacts were the .argest: a saving of $2,064 per sample member over the three years, or 14 percent 
of the average payments to controls. Butte, Los Angeles, and San Diego were in the middle range at 
$1,271 (7 percent), $1,246 (5 percent), and $1,327 (7 percent), respectively. Tulare produced no 
AFDC impacts. Alameda showed AFDC savings for the first time in year 3 ($447, or 6 percent for 
the year), but the sample was too small to permit confidence in this result. 

By year 3, AFDC impacts were declining in Los Angeles, Riverside, and San Diego, although 
possibly not in Butte. It was not clear that there would be much addition to total AFDC impacts after 
year 3 except in Alameda and Butte. The time pattern for Tulare does not suggest the appearance of 
significant AFDC impacts there in the future. 

For subgroups, both earnings gains and welfare savings were generally larger for the group 
assessed as not in need of basic education, a pattern that, at least for earnings gains, was similar to 
the one found for AFDC-FG registrants. Impact estimates for a variety of subgroups defined by 
welfare history and recent prior employment, ethnicity, number of children, and other characteristics 
turned up no clear evidence that any particular subgroup or subgroups reduced the overall impacts of 
GAIN for AFDC-Us. Subgroup analysis also revealed that the large earnings impacts in Butte came 
partly from that county's large number of first-time AFDC-U applicants, who also had large earnings 
impacts in certain other counties, and partly because Butte achieved larger earnings impacts than the 
other counties for some subgroups. Bringing the impacts for those subgroups up to the level achieved 
in Butte would raise earnings impacts for AFDC-Us. 



^As noted in Chapter 4, throughout the impact analysis, rounding may cause slight discrepancies in calcu- 
lating sums and differences. 
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A Context for Understanding GAIN^s Three-Year AFDC-U Impacts 



In this report, the FG and U assistance categories are treated separately because they are subject 
to different program rules and labor market and welfare constraints. As discussed in Chapter 1, rules 
defining mandatoriness for GAIN piior to the transition to JOBS exempted AFDC-FG case heads with 
a child under age 6. For this reason, nearly two-thirds of the AFDC-FG caseload at that time was not 
in the intended target group for the GAIN participation requirement. No such exemption existed for 
AFDC-U case heads. Thas, except in Alameda and Los Angeles, which worked exclusively with long- 
term recipients, GAIN targeted virtually the whole of the able-bodied AFDC-U caseload. Impacts 
reported in this chapter may therefore be more readily translated into impacts on the full AFDC-U 
caseload (of orientation attenders) than is possible for AFDC-FGs. 

The limited number of experimental studies performed for the AFDC-U assistance category 
makes it difficult to establish a relevant context for understanding the three-year impacts of GAIN on 
AFDC-Us. Of the nine broad-coverage studies discussed in Chapter 4, only two offered reliable 
results for AFDC-Us: the San Diego EPP/EWEP evaluation and the San Diego SWIM demonstra- 
tion."* The impact estimates from these experiments will be discussed below, but it is worth 
considering first some reasons why impacts for AFDC-Us might be different from impacts for 
AFDC-FGs. 

Certain differences between AFDC-FG and AFDC-U registrants may lead to differences in 
impacts on eaminfis. Case heads in AFDC-U cases are almost always male and, on average, have 
greater work experience than AFDC-FG case heads (see Table 1,2). In addition, because there is a 
second parent present in the household, the need to care for children does not generally interfere with 
AFDC-U employment, as it can for AFDC-FGs. 

Other differences between AFDC-FGs and AFDC-Us may tend to produce differences in wel- 
fare impacts. AFDC-U cases generally receive larger monthly AFDC payments than AFDC-FG cases 
because two parents rather than one are figured into the grant amount. AFDC-Us are, however, 
subject to tighter AFDC eligibility requirements and, for part of the follow-up period, faced more 
stringent penalties for noncooperation with GAIN. According to regulations in effect during the 
research period, eligibility for /\FDC-U terminated when the case head worked more than 100 hours 
in a month, regardless of the amount of earnings.^ Also, in GAIN prior to JOBS, a sanction closed 
the AFDC-U case entirely and terminated payments completely, whereas it reduced the monthly grant 
for AFDC-FG registrants. Under JOBS (as of July 1989), sanction penalties for AFDC-U registrants 
became the same as they are for AFDC-FG registrants. Reductions in AFDC payments were found 
for AFDC-Us in both the San Diego EPP/EWEP and SWIM programs, which operated under the 
tighter, pre-JOBS eligibility and sanctioning rules. 

In the evaluation of the San Diego EPP/EWEP program, which consisted of job search and 
work experience, follow-up lasted through quarter 6 only. First-year earnings gains were about $150 



^The Baltimore Options program worked with AFDC-Us. but the AFDC-U sample there was only large 
enough to give estimates of employment and welfare receipt rates. It was not large enough to provide reliable 
estimates of the differences in rates between experimentals and controls, which constitute estimates of program 
impacts. 

^In Riverside, the 100-hour rule was suspended beginning January 1, 199L Whether this change 
influenced the trend in Riverside*s impacts on AFDC-Us is uncertain. 

-195- 




per experimental.^ First-year welfare savings were $375. The experimental-control differential for 
both earnings gains and, to a lesser extent, welfare savings showed substantial decrease by the middle 
of year 2, however. It should be noted that the ratio of welfare savings to earnings gains in this study 
was higher for AFDC-U? than for AFDC-FGs.'^ 

More recently, the San Diego SWIM demonstration yielded first-year earnings gains and welfare 
savj:igs of $500 and $400, respectively. Earnings effects appear to have persisted at this level through 
ye'ir 2, and welfare impacts appear to have grown to $550 in year 2. In year 3 and afterwards, both 
earnings impacts and welfare impacts declined, possibly because controls as well as experimental got 
into GAIN.^ As indicated in Chapter 4, the San Diego SWIM program model was somewhat similar 
to the GAIN job-search-first track. Again, the ratio of welfare savings to earnings gains was higher 
for AFDC-Us than for AFDC-FGs.^ 

For AFDC-Us, there are no prior experimental studies of broad-coverage programs incor- 
porating education and training as possible initial assigned activities. Urns, past experimental experi- 
ence does not provide much guidance on what to expect from the education track in GAIN. 



III. Three-Year Impacts for the Pooled (Six-County) Sample and the Individual Counties 

Figure 6.1 presents average quarterly earnings and average quarterly AFDC payments for the 
experimental and control group samples in the six counties. These quarterly estimates and other 
impact estimates for the AFDC-U samples are shown in detail in Appendix Tables G. 1 through G.6. 

A. The Behavior of Controls 

The AFDC-U program is often thought of as a program mainly of short-term assistance. 
Eligibility for AFDC-U requires that the primary earner in a family must have liad some recent labor 
force attachment. In comparison to AFDC-FG controls, AFDC-U controls often did find jobs more 
readily during the follow-up period (except in Alameda and Butte), but the differences were not as 
large as might have been expected. Control group employment rates for AFDC-U samples at tlie end 
of year 3 (i.e., in quarter 13) were as follows: 

Alameda 
Butte 

Los Angeles 
Riverside 
San Diego 
Tulare 



12.3 percent employed 

27.6 

19.5 

28.5 

34.0 

32.6 



^Impact estimates for earlier programs have not been inflated to current dollars. 

^This San Diego experiment had a second experimental group, which received ooly job search. For this 
group, first-year earnings gains were $400 and welfare savings were $300, and both impacts showed the same 
pattern of sharp decline going into year 2. 

®For estimates and a dircussion of GAIN participation among SWIM experimentals and conn-ols after the 
end of the SWIM demonstration, see Friedlander and Hamilton, 1993. 

^See Friedlander and Hamilton, 1993. 

^^As in Chapter 4, the full sample in some counties has more than 13 quarters of follow-up. 
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There was greater crosS'<:ounty variation in these employment rates than there was for AFDC-FGs. 
Except for San Diego and Tulare, these rates were lower than those found in prior research, especially 
for Alameda and Los Angeles. As with AFDC-FG controls, the lower rates in Alameda and Los 
Angeles reflected those two counties' policy of working with long-term recipients, and probably owed 
much less to labor market conditions than did the rates in other counties. 



Rates of welfare receipt among AFDC-U controls showed the typical pattern of departure from 
AFDC, but a substantial number remained on public assistance at the end of the third follow-up year 
(quarter 13). At that point, AFDC receipt rates were as follows: 



Alameda 79.7 percent received AFDC 

Butte 52.7 

Los Angeles 77.9 

Riverside 40.9 

San Diego 57.2 

Tulare 59.9 



As was the case for employment, there was considerable variation across counties. Surprisingly, with 
only one exception (Riverside), the rate of AFDC receipt in each county exceeded the corresponding 
rate for that county's AFDC-FG sample. These rates were generally higher than those found in 
previous research. Again, rates for Alameda and Los Angeles were higher than elsewhere, owing 
to the fact that these counties worked exclusively with long-term recipients. It should also be noted 
that the rate for Riverside was substantially lower than in any of the other five counties. 

B. Impacts on Employment. Earnings, AFDC Receipt, and AFDC Payments 

The difference between experimentals and controls presented in Figure 6.1 is the estimate of 
gain's impacts on earnings and AFDC payments. These and other numerical estimates of program 
impacts are shown in Table 6. 1 (and in Appendix Tables G. 1 through G.6). This table shows year-by- 
year and summary estimates for the first three years (i.e., quarters 2 through 13),^^ estimates of 
employment at the end of year 3, and estimates of welfare receipt at the end of each of the three years 
of follow-up. Estimates for year 3 are particularly important for the AFDC-U samples because some 
prior experimental research on AFDC-Us has shown substantial narrowing of any experimental-control 
difference in earnings by that time.^** 



The most relevant comparison is with AFDC-Us in the San Diego SWIM demonstration sample, where 
the employed rate for controls at quarter 13 was 36.0 percent. 

^^The AFDC receipt rate for AFDC-Us in the SWIM study - the most relevant comparison available - 
was 44.6 percent in quarter 13. 

^^Again, quarter 1 (the quarter of random assignment) is omitted in the summary measures because, for 
some sample members, that quarter may have included earnings and AFDC payments that preceded random 
assignment. 

^"^In the San Diego EPP/EVvEP study, the quarterly impact on earnings for AFDC-Us declined during the 
first follow-up year from a peak in quarter 2 in the range of $125 to $150 per experimental to around $10 in 
quarter 6. In San Diego SWIM, earnings impacts held up through year 2, then began to decrease in year 3 
and by year 4 were down to zero. See Friedlander and Hamilton,. 1993. 
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TABLE 6.1 



GAIN'S THREE-YEAR IMPACTS ON EMPLOYMENT, EARNINGS, 
AFDC RECEIPT, AND AFDC PAYMENTS FOR AFDC-U REGISTRANTS 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Alameda 



Ever employed (%). 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 



Average total AFDC 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 



Sample size (total = 182) 



payments received ($) 



29.8 
27.6 
27.5 
20.2 
46.6 



1115 
1332 
1600 
4047 



94.6 
86.2 
67.1 



10066 
9071 
7505 

26643 



96 



20.2 
20.4 
16.9 
12.3 
27.0 



1061 
1133 
1072 
3265 



93.3 
85.2 
79.7 



9905 
8889 
7952 
26746 

86 



9.6 * 

7.2 
10.6 * 

7.9 
19.6 



54 
200 
528 
782 



1.3 
1.0 
-12.6 



161 
182 
-447 
-103 



47.3% 
35.4% 
62.7% 
64.1% 
72.7% 



5.1% 
17.6% 
49.3% 
23.9% 



1.4% 
1.2% 
-15.8% 



1 .6% 
2.1% 
-5.6% 
-0.4% 



Butte 

Ever employed (%) 
Yearl 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1006) 



51.4 
50.4 
48.1 
32.1 
67.5 



3026 
4033 
4752 
11811 



63.7 
52.8 
47.9 



6523 
5246 
4555 
16324 

780 



44.1 
45.5 
41.9 
27.6 
63.6 



2393 
2776 
3346 
8515 



67.0 
57.6 
52.7 



6749 
5775 
5071 
17595 

226 



7.3 ** 
4.9 
6.2 * 
4.6 
3.8 



633 * 
1257 *** 
1406 ** 
3295 *** 



-3.3 
-4.7 
-4.8 



-226 
-529 
-516 
-1271 



16.6% 
10.8% 
14.7% 
16.6% 
6.0% 



26.5% 
45.3% 
42.0% 
38,7% 



-4.9% 
-8.2% 
-9.1% 



-3.4% 
-9.2% 
-10.2% 
-7.2% 



(continued) 
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TABLE 6.1 (continued) 



County and Outcome 



Experimentais 



Controls 



Difference 



Percentage 
Change 



Los Angelas 

Ever employed (%) 
Yean 
Year 2 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1 458) 



41.2 
39.0 
35.8 
29.5 
51.1 



1480 
1787 
1726 
4993 



91.1 
85.5 
78.4 



9440 
8333 
7417 
25190 

735 



29.4 
29.3 
26.0 
19.5 
36.4 



1221 
1468 
1417 
4106 



92.3 
85.3 
77.9 



9871 
8826 
7739 
26436 

723 



11.8 *** 

9.7 *** 

9.8 *** 
10.0 *** 
14.7 *** 



259 ** 
319 * 
309 
887 ** 



-1.1 
0.1 
0.5 



-431 *** 
-493 *** 
-323 * 
-1246 *** 



40.1% 
33.0% 
37.7% 
51.3% 
40.3% 



21.2% 
21.7% 
21.8% 
21 .6% 



-1.2% 
0.2% 
0.6% 



-4.4% 
-5.6% 
-4.2% 
-4.7% 



Riverside 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years i -3) 

Ever received any AFDC payments (%) 
Last quarter of year i 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 2323) 



57.2 
51.3 
44.8 
31.1 
69.1 



3691 
4038 
3812 
11542 



51.1 
46.9 
42.6 



4840 
3892 
3614 
12346 

1590 



48.6 
44.7 
40.2 
28.5 
61.3 



2930 
3628 
3478 
10036 



56.9 
49.5 
40.9 



5807 
4640 
3964 
14411 

733 



8.6 *** 
6.6 *** 
4.6 ** 

2.6 

7.8 *** 



761 
411 
334 
1506 



-5.8 
-2.6 
1.7 



-967 *** 
-748 *** 
-350 * 
-2064 *** 



17.7% 
14.8% 
1 1 .3% 
9.3% 
12.7% 



26.0% 
1 1 .3% 
9.6% 
15.0% 



-10.2% 
-5.3% 
4.1% 



-16.7% 
-16.1% 
-8.8% 
-14.3% 
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TABLE 6.1 (continued) 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



San Diego 

Ever employed (%) 
Yean 
Year 2 
Years 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Years 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Lastquarter of year - 

Average total AFDC payments received ($) 
Yearl 
Year 2 
Years 

Total (years 1 -3) 
Sample size (total = 3272) 



Tulare 

Ever employed (%) 
Yearl 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 -3) 

Average total earnings ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1901) 



53.9 
50.0 
45.6 
34.6 
67.3 



3331 
4128 
4144 
11603 



69.4 
61.8 
56.9 



6790 
5565 
5155 
17510 

2427 



52.5 
50.2 
48.9 
35.2 
67.0 



2987 
3721 
4121 
10829 



74.6 
66.4 
60.4 



7545 
6316 
5588 
19449 

1319 



50.1 
45.8 
43.9 
34.0 
64.6 



3089 
3978 
4402 
11469 



74.6 
64.0 
57.2 



7301 
6197 
5339 
18837 

845 



51.2 
48.9 
48.4 
32.6 
64.0 



2961 
3998 
4138 
11097 



74.5 
65.3 
59.9 



7523 
6261 
5600 
19384 

582 



3.8 
4.2 
1.7 
0.6 
2.7 



242 
150 
-258 
134 



-5.2 *** 

-2.2 

-0.2 



-510 *** 
-632 *** 
-184 
-1327 



1.3 
1.3 
0.5 
2.5 
3.0 



26 
-277 
-17 
-268 



0.2 
1.1 
0.5 



23 
54 

-12 



7.6% 
9.1% 
3.9% 
1.6% 
4.1% 



7.8% 
3.8% 
-5.9% 
1.2% 



-7.0% 
-3.5% 
-0.4% 



-7.0% 
-10.2% 
-3.4% 
-7.0% 



2.5% 
2.6% 
1.0% 
7.8% 
4.7% 



0.9% 
-6.9% 
-0.4% 
-2.4% 



0.2% 
1.7% 
0.9% 



0.3% 
0.9% 
-0.2% 
0.3% 



(continued) 
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TABLE 6.1 (continued) 



County and Outcome 



Experimental 



Controls 



Difference 



Percentage 
Change 



AM counties (a) 

Ever employed (%) 
Yean 
Year 2 
Year 3 

Last quarter of year 3 
Total (years 1 ~3) 

Average total earnings ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 

Ever received any AFDC payments (%) 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average total AFDC payments received ($) 
Yean 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 9960) 



51.2 
48.2 
44.6 
32.5 
64.4 



2903 
3542 
3711 
10156 



70,0 
62.7 
57.3 



7028 
5871 
5266 
18164 

6851 



44.7 
42.8 
40.1 
28.4 
58.0 



2519 
3170 
3356 
9045 



73.0 
64.3 
57.7 



7450 
6340 
5543 
19332 

3109 



6.6 *** 

5.3 *** 

4.5 *** 
4 *** 

6.4 *** 



384 *** 
372 ** 
355 ** 
1111 *** 



-3.0 *** 

-1.7 

-0.5 



—422 *** 
-469 *** 
-277 *** 
-1168 *** 



14.7% 
12.4% 
11.3% 
14.3% 
11.0% 



15.3% 
11.7% 
10.6% 
12.3% 



-4.2% 
-2.6% 
-0.8% 



-5.7% 
-7.4% 
-5.0% 
-6.0% 



SOURCE: MDRC calculations from California Unemployment Insurance (Ul) earnings records and from county 
AFDC records. 

NOTES: The sample for this table consists of individuals v/ho v/ere randomly assigned as follows: 

Alameda July 1989-May 1990 

Butte March 1988-March 1990 

Los Angeles July 1989-March 1990 

Riverside August 1988-March 1990 

San Diego August 1988 -September 1989 

Tulare January 1989- June 1990 

The sample used to analyze GAIN'S impacts is slightly smaller than the full research sample. 

Dollar averages include zero values for sample members not employed or not receiving welfare. 
Estimates are regression -adjusted using ordinary least squares, controlling for pre-random assignment 
characteristics of sample members. Rounding may cause slight discrepancies in calculating sums and 
differences. 

For all measures, year 1 refers to follow-up quarters 2-5; year 2, to quarters 6-9; and year 3, to quarters 
10-13. Quarter 1 referstothecalendarquarterin which random assignment occurred. Because quarter 1 
may contain some earnings and AFDC payments from the period prior to random assignment, it is excluded 
from the summary measures of follow-up. 

A two-tailed t-test was applied to differences between experimental and control groups. Statis- 
tical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) In the all-county averages, the results for each county, except Alameda, are weighted equally. Alameda 
is excluded because its AFDC-U impacts are based on a very small sample. 
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As was the case for AFDC-FGs, large impacts were found in Riverside. ^ In that county, 
69.1 percent of experimentals worked at some time during the first three years. The corresponding 
rate for controls was 61.3 percent, for a difference, or impact, of 7.8 percentage points. By year 2, 
however, the employment impact had declined somewhat, and it declined further in year 3, 
Employment rates for both experimentals and controls were lower in year 2 than in year 1, and lower 
in year 3 than in year 2, but the decline was greater for experimentals. Consequently, the experi- 
mental-control differential in percentage employed also declined, from 8.6 percentage points in year 

1 to 6.6 percentage points in year 2 and 4.6 percentage point^^ in year 3. 

Earnings gains, like employment impacts, decreased over time: from a statistically significant 
$761 in year 1 to a not statistically significant $411 the following year, and a not statistically signifi- 
cant $334 in the final year. As may be seen in Figure 6.1, control group earnings increased 
substantially iii year 1, narrowing the gap between experimentals and controls. Over the full three- 
year period, there was a significant degree of convergence between experimentals and controls, and 
by quarter 13, experimentals were earning, on average, just $26 more than controls (not shown in the 
table). Total earnings for the three years were higher by $1,506. 

Riverside's welfare impacts also declined over time, decreasing by more than half between year 

2 and year 3 after a smaller decline from year 1 to year 2. Welfare impacts for Riverside AFDC-Us 
were larger than for AFDC-FGs in that county up until year 3, but the third-year impact was larger 
for AFDC-FGs. The three-year impact on total AFDC payments, $2,064, was only slightly larger for 
AFDC-Us than the three-year savings for AFDC-FGs, although both figures were the largest among 
the counties. Nevertheless, AFDC outcomes for AFDC-U experimentals and controls increasingly 
converged throughout most of the follow-up period. The average difference in AFDC receipt peaked 
in quarter 3, when 59.3 percent of experimentals received an AFDC payment compared to 68.6 
percent of controls and AFDC payments for experimentals averaged $296 less. By quarter 9, the 
experimental-control difference in AFDC receipt had dropped to 2,6 percentage points, and the savings 
had fallen to $144; by quarter 13, impacts were around zero. The cumulative three-year impacts on 
AFDC savings were larger than the tliree-year earnings impacts. 

The largest three-year earnings gains, $3,295, were found in Butte. Unlike the results for 
Riverside, earnings impacts in Butte grew substantially from, year 1 to year 2, approximately doubling 
(from $633 to $1,257), and then grew again from year 2 to year 3 (from $1,257 to $1,406). in addi- 
tion, the experimental-control difference in average earnings appears not to have peaked until year 3, 
suggesting that, at least for a while, experimentals will continue to record higher earnings than 
controls. Earnings gains exceeded welfare savings by a considerable margin, another difference 
between Butte and Riverside. Welfare savings in Butte grew from $226 in year 1 to $529 in year 2 
and remained at close to that amount in year 3, making a three-year total of $1,271. Cumulative 
three-year welfare impacts in Butte were not statistically significant, but quarterly welfare impacts kept 
increasing until year 3, reaching a peak saving of 14.3 percent of control payments (statistically signifi- 
cant) in quarter 13, 

Los Angeles was the only other county to record statistically significant earnings gains during 
the three-year follow-up period, although the three-year impact of $887 was much smaller than Buttt's 



^^Variation in impacts across counties for AFDC-Us was statistically significant at the 1 percent level for 
total three-year earnings and at the 10 percent level for total three-year AFDC payments. 
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or Riverside's. In Los Angeles, as in Butte, the experimental-control difference in average earnings 
grew larger from year 1 to year 2, but it did not increase from year 2 to year 3, Welfare savings 
exceeded earnings gains by about $170 during each of the first two years and then fell to match 
earnings gains in year 3, a pattern more like Riverside's, Employment impacts in Los Angeles were 
large relative to earnings impacts there, just as they were for AFDC-FGs, 

In San Diego, AFDC reductions outpaced earnings gains by an even wider margin than in Los 
Angeles. GAIN achieved only a small and not statistically significant increase of $134 in total earnings 
during the three-year follow-up period, and the experimental-control difference had all but disappeared 
as early as quarter 9, At the same time, Sz.n Diego's GAIN program continued to produce statistically 
significant AFDC reductions, although impacts diminished substantially (i.e., by more than two-thirds) 
between year 2 and year 3. In all, experimentals averaged $1,327 less in AFDC payments than 
controls during the three-year follow-up period. 

In Tulare, experimentals earned about the same amount as controls in year 1, slightly less in 
year 2 (not a statistically significant difference), and about the same amount again in year 3. The 
overall three-year earnings impact was slightly negative, but it was not statistically significant and 
should be interpreted as no earnings impact. GAIN produced no welfare savings in Tulare at any time 
in the follow-up. 

AFDC-U samples in Alameda were too small to yield reliable estimates of differences between 
experimentals and controls. Nonetheless, the results there, despite their imprecision, were similar to 
the finding in Los Angeles that impacts on employment can exceed impacts on earnings for AFDC-Us. 
This same pattern was found in San Diego, too, during the first two years, when that county had 
employment impacts. This suggests that the new jobs found by experimentals in those counties paid 
less than the jobs typically held by controls, either because hourly wage rates were lower or weekly 
hours were shorter or turnover was more frequent. In Riverside, and even more so in Butte, earnings 
impacts were relatively large compared to employment impacts, suggesting that experimentals found 
"better" - i.e., higher-paying or more stable — jobs than controls. Finding better jobs may 
therefore be an important element of achieving larger earnings impacts. 

Analysis of AFDC impacts reveals differences across counties. In Butte, Riverside, and San 
Diego, more than half the three-year welfare savings came from fewer months on AFDC. (See 
Appendix Tables G.l through G.6 for impacts on months receiving AFDC.) The remainder was 



^^One approach to comparing the magnitudes of employment and earnings impacts is to divide each impact 
estimate by the corresponding control group mean (average) to estimate the relative gain or "impact relative 
to the control group mean. " If jobs of experimentals and controls paid about the same per quarter of employ- 
ment, then it follows that the relative gain in the number of quarters employed and average total earnings must 
have been quite similar. That is, if the time worked increased by a given percentage, then total earnings will 
increase by the same percentage if earnings per time period do not change. Although not shown in Table 6.1, 
impacts on number of quarters of employment during the three-year follow-up were calculated for all counties, 
along with gains relative to the control group means. In Alameda, Los Angeles, and San Diego, these 
measures showed tliat the relative gain in employment was much larger than the relative gain in earnings. 
In Riverside, the two relative gains were similar. In Butte, the relative gain in employment was about 55 
percent of the relative gain in earnings. 

Additional support for this hypothesis may be found in Friedlander and Burtless, forthcoming. 
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associated with reduced average grant amounts per month of receipt for experimentals, possibly the 
effect of sanctions or an increase in experimentals' employment while they were on AFDC. This 
pattern could also have resulted if the overall reduction in months of receipt fell primarily on cases 
with above-average monthly grant amounts. Another contributing factor could have been the switching 
of some cases from AFDC-U to AFDC-FG status: when the father stops being part of an AFDC-U 
family (and the mother becomes an AFDC-FG case head), the monthly payment amount to the case 
is lower because there is one fewer family member. For Los Angeles, there was no impact on the 
number of months of AFDC receipt over the follow-up period, despite the moderately large dollar 
amount of AFDC savings. 

As was the case for AFDC-FGs, measures summarizing results for AFDC-Us across all counties 
are of some interest. Averaging across five counties (omitting Alameda because the sample there was 
small), and giving each county equal weight, yields three-year earnings gains for AFDC-Us of $1,111 
per experimental group member and three-year welfare savings of $1,168, both statistically significant. 
As discussed in Chapter 4, and as shown in Table 6.2, slightly different impact estimates are obtained 
from weighting by the size of each county's GAIN caseload. This second method yields an average 
earnings gain of $853 and an average welfare saving of $1,251.'^^ According to a third way of 
estimating GAIN's effects - weighting by county sample sizes - experimentals averaged $807 more 
in earnings during the three-year follow-up and received $1,216 less in AFDC payments. 



IV. Impacts on Earnings Levels 

As for AFDC-FGs, impacts on the distribution of earnings for AFDC-Us suggests that obtaining 
"better" jobs was important in producing relatively large earnings unpacts. Again, the implication is 
that the estimated average earnings impact obscures a substantial variation in GAIN's effects across 
sample members. 

Table 6.3 gives the percentage of experimentals and controls whose earnings for year 3 were 
in each of several brackets, laid out in the same format as in Chapter 4. Across counties, having a 
larger earnings impact is associated with having an impact in hi^er earnings brackets. Butte, the 
county with the largest third-year earnings impact (see Table 6.1), was the only county to show an 



ERLC 



^^Cases that entered the research sample as AFDC-U cases were kept in the AFDC-U sample even if that 
case subsequently became an AFDC-FG case. Welfare payments to the case continued to be entered into the 
research data, even though the original case head stopped being the case head. In an unpublished MDRC 
study on the San Diego SWIM data, it was found that about half of the AFDC-U cases in the control group 
converted to AFDC-FG status sometime during the five-year follow-up. SWIM increased this rate by about 
five percentage points for experimentals. 

^^e average monthly payment for controls is obtained by dividing the average total dollar amount by 
the average number of mondis during which AFDC payments were received. Multiplying this figuic by the 
reduction in months indicates what the total reduction in AFDC payments would have been had average 
monthly payment amounts been the same for experimentals and controls who remained on welfare. In River- 
side and San Diego, the figure is about 60 percent. In Butte, it is about one-half. In Los Angeles, there was 
no overall reduction in months on AFDC. 

^^Including Alameda in the averages gives summary estimates of earnings gains of $1,056 (equal 
weighting), $852 (weighting by GAIN caseload size), and $806 (weighting by county sample size). The 
corresponding averages for AFDC savings are: $991, $1,234, and $1,196. 
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TABLE 6.3 

GAIN'S IMPACTS ON THE DISTRIBUTION OF EARNINGS IN YEAR 3 FOR AFDC-Us 



County and Outcome 


Percent in Annual Earnings Bracket 


Percent in Annual Earnings Bracket (a) 


Experimentals 


Controls 


Difference 


Employed 

CZAfJcf ifJieniaiS 


Employed 


D iff a rort/^o 


Alameda 














None 


72.5 


83.1 


-10.6 * 








$1 -$1 ,999 


8.5 


4.5 


4.0 


30.8 


26.5 


4.3 


$2,000-$4,999 


11.4 


4.7 


6.7 * 


41.3 


27.9 


13.4 


$5,000~$9,999 


3.3 


3.3 


-0.1 


11.9 


19.6 


-7.6 


$10,000~$1 9,999 


1.8 


3.8 


-2.0 


6.6 


22.4 


-15.9 


$20,000 or more 


2.6 


0.6 


2.0 


9.4 


3.5 


5.9 


Sample size (total =182) 














Butte 














None 


51 .9 


58.1 


-6.2 * 








$1 -$1 ,999 


10.9 


9.7 


1.2 


22.7 


23.2 


-0.5 


$2,000~$4,999 


10.0 


9.7 


0.4 


20.8 


23.1 


-2.2 


$5 ,000 -$9,999 


9.4 


9.2 


0.1 


19.5 


22.0 


-2.5 


$10,000-$1 9,999 


11.8 


10.3 


1.5 


24.5 


24.4 


0.0 


$20,000 or more 


6.0 


3.1 


3.0 * 


12.5 


7.3 


5.2 


Sample size (total =1006) 














Los Anqeles 














None 


64.2 


74.0 


-9.8 *** 








$1 -$1 ,999 


5.9 


5.1 


0.8 


16.5 


19.5 


-3.1 


$2,000-$4,999 


22.7 


14.8 


7.9 *** 


63.4 


57.0 


6.4 


$5,000-$9,999 


4.1 


3.1 


1.0 


1 1.4 


1 1.8 


—0.4 


$10,000-$19,999 






n o 
— u.^ 


R 7 

O.f 


O.O 


— P Q 


$20,000 or more 


1.1 


0.8 


0.3 


3.1 


3.2 


-0.1 


sample size (total = i4oo) 














Riverside 














None 




RQ ft 










$1 — $1 ,999 


11.^ 


1 1 .u 






27.3 


—2.3 


$2,000-$4,999 


lU.o 




on** 






4.8 


$5,000— $9,999 


y.u 


in o 


— 1 o 


on 1 


QR 




$10,000~$1 9,999 




7 9 


2.3 * 


2i 3 


17.9 


3.4 


$20,000 or more 


4.8 


4.6 


0.2 


10.6 


11.3 


-0.7 


oampie size (total =^:o^:>3j 














San Diego 














None 


A 


1 


— 1 7 








$1 — $1 ,999 


1 u.o 




1 .2 


23.0 


21.2 


1.8 


$2 ,000-54,999 


AO A 


1 1 

1 1 .o 


n 7 




9^ R 


0.7 


$5 ,000— $9 ,yyy 


7.4 


6.3 


1 .1 




1 


1 R 


$10,000— $19,999 


9.7 




0.4 








$20,000 or more 


b.U 




— 1 ft * 

— 1 .o 




17 7 




Sample size (total =3272) 














Tulare 














None 


51.1 


51.6 


-0.5 








$1 -$1,999 


11.5 


12.5 


-1.0 


23.5 


25.7 


-2.2 


$2,000-$4,999 


10.2 


8.9 


1.2 


20.8 


18.5 


2.3 


$5,000-39,999 


11.6 


9.6 


2.0 


23.8 


19.9 


3.9 


$10,000-$19,999 


11.2 


13.2 


-2.0 


22.8 


27.3 


-4.5 


$20,000 or more 


4.5 


4.2 


0.3 


9.1 


8.6 


0.5 


Sample size (total =1901) 















ERIC 



SOURCE: See Table 6.1. 

NOTES: See Table 6.1. 3 ^ S 

Where data are not applicable, dashes are used. ^ 
(a) Estimates in italics were based only on persons with earnings. Statistical tests were not 
O „ applied to the differences. -209- 



increase in employment in the upper earnings bracket ($20,000 or more),^^ which accounted for 
possibly as much as two-thirds of its total earnings impact.^^ Butte did not show increases in the 
lower earnings brackets (below $10,(X)0). In contrast, Los Angeles showed a larger total increase in 
employment than Butte, but that increase was concentrated in the lower earnings brackets, which 
produced only a moderate total earnings impact for year 3. Riverside had less of an employment 
impact than Los Angeles, but some of it accrued in the next-to-highest bracket, giving that county a 
moderate total earnings gain for year 3. Finally, Tulare, with about a zero earnings impact for year 
3, showed no effect on employment in any bracket, and San Diego, with a slightly negative earnings 
impact for year 3, showed a negative effect on the highest earnings bracket. 



V. County Comparisons Using AFDC-FG and AFDC-U Results 

The magnitude of impacts for AFDC-FGs and AFDC-Us was correlated across counties. 
Counties with impacts for AFDC-FGs that were large or small compared to impacts for AFDC-FGs 
in other counties tended to obtain impacts for AFDC-Us that were also large or small compared to 
impacts on AFDC-Us elsewhere. This relationship was substantially stronger for welfare savings than 
for earnings gains. Omitting Alameda and weighting the remaining counties equally, the simple 
correlation between earnings gains for AFDC-FGs and AFDC-Us across counties is +0.33 (of a 
maximum of -hl.OO); for welfare savings, the correlation coefficient is +0.99.^^ The high degree 
of correlation for welfare savings across counties stems from the strong showing for both target groups 
in Riverside and the weak showing for both in Tulare. The much lower correlation of earnings gains 
for AFDC-FGs and AFDC-Us across counties is, in part, attributable to the large increase in earnings 
impacts for AFDC-Us in Butte from year 1 to year 2 and its persistence in year 3. 

There was also a strong relationship between earnings gains and welfare savings across counties, 
particularly for AFDC-FGs. Relatively large earnings gains were associated with relatively large 
AFDC payment reductions. The simple correlation coefficient between earnings gains and welfare sav- 
ings for AFDC-FGs (six counties) is -hO.81; for AFDC-Us (five counties), it is -hO.49.^'^ The strong 
relationship between earnings gains and welfare savings for AFDC-FGs depends in large part on the 
results for Riverside and Tulare. The same relationship for AFDC-Us is weaker because the large 
earnings impact in Butte was not accompanied by a correspondingly large welfare impact. In addition, 
from year 1 to year 2, Riverside's AFDC-U earnings impacts fell out of first place among the 
counties, while the AFDC-U welfare savings for that county remained the largest. 



VL Impacts After the Third FoUow-Up Year 

Figure 6.2 presents experimental-control differences in earnings and AFDC payments separately 
for early cohorts and full county samples, along with the dates that define the cohorts and their sample 



Alameda had a small increase in the top bracket, but that was offset by a decrease of the same size in 
the next-lower bracket. 

^^See Chapter 4 for the derivation of this estimate. 

^^Correlations that also include Alameda are similar: +0.32 for earnings gains and -f 0.90 for welfare 
savings. 

^^Including Alameda in the AFDC-U correlation makes it +0.47, quite close to the five-county number, 
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sizes. The early cohort sample for Alameda was too small for meaningful analysis. The early cohort 
in Butte was also relatively small, and the impact estimates there should be considered of below- 
average reliability. 

Information from this cohort analysis changes the picture of AFDC-U impacts very little. 
Impact estimates for the full AFDC-U samples and the early cohorts indicate that, for the most part, 
earnings impacts may have reached a peak as early as year 1 or the first part of year 2, with relatively 
modest or declining effects after that point. Welfare reductions, when they occurred, showed a similar 
pattern. The one possible exception to this pattern was Butte, where the experimental-control differen- 
tial in earnings grew through the middle of year 3. 

Riverside's results for both the full sample and the early cohort indicate a sharp decline in year 
1 followed by a slower tapering off over the next two years, although some experimental-control dif- 
ference in earnings may persist beyond year 3.. Earnings impacts had fallen to approximately zero by 
the beginning of year 2 for the early cohort, as shown in the Riverside earnings graph. For the full 
sample as well, earnings gains were well below their peak by year 2. The late cohort does show an 
up-tick from quarter 14 to quarter 15, which may carry full sample earnings gains at a level of about 
$100 per quarter ($400 annualized), or slightly higher, in year 4. But the late cohort falls off again 
in quarters 17 and 18. Insufficient information is available at this time to predict the precise course 
of earnings gains for Riverside's AFDC-Us with any confidence after about the middle of year 4. 
Regarding AFDC payments, the experimental-control differential for both the full sample and the early 
cohort began to taper off in year 1. The full sample curve looks more favorable than that for the early 
cohort, but does not alter the expectation that almost all of the AFDC impact for AFDC-Us in 
Riverside occurred within three years after program entry. 

In San Diego, earnings impacts for the full sample and the early cohort were in the vicinity of 
zero by year 3 and support the conclusion that overall earnings impacts for AFDC-Us reached their 
maximum in year 1. In Los Angeles, the full sample earnings impact appeared to be holding steady 
at a low level, while the early cohort impacts declined and became negative. It is difficult to judge 
what the combined effect will be for year 4 and beyond. Both Los Angeles and San Diego showed 
greater welfare savings in year 2 than in year 1, but much less in year 3, with a possible peak in the 
experimental-control welfare differential around the beginning of year 2. 

Butte is the only county where the full AFDC-U sample showed earnings gains that increased 
quarter by quarter, although impacts appear to have leveled off by year 3. The early cohort results 
in Butte are of particular interest, since they suggest that year 4 may show a decline in earnings 
impacts rather than a steady effect. The experimental-control differentials in AFDC payments for the 
full sample and the early cohort in Butte did not show the decline found in Riverside and other 
counties: Savings were larger in year 2 than in year 1, persisted in year 3, and may hold up for some 
time beyond that point. 

Neither the full sample nor the early cohort in Tulare gives evidence that impacts on earnings 
or AFDC payments are likely to appear over time in that county. 



VII . Three- Year Impacts for Subgroups 

The subgroup analysis for AFDC-U registrants parallels that for AFDC-FG registrants. 
Subgroups are defined the same way, and the analysis methods are the same. In each county, sub- 
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group samples were smaller than the full samples, with the associated decrease in precision and statisti- 
cal significance. As indicated earlier, impact estimates for very small samples will be flagged in the 
subgroup tables with the symbol "u" (for unreliable") to indi:<ate low reliability. 

A. Assessed Need for Basic Education 

Tables 6.4 and 6.5 present the impacts of GAIN for AFDC-Us by county, separately for 
portions of the samples determined by GAIN not to need or to need basic education. Because of the 
very small not-in-need and in-need subgroups in Alameda, that county's impact estimates are flagged 
in these tables. The not-in-need subgroup in Los Angeles was quite small, too, and the dollar amounts 
of its impact estimates have low reliability. Of below-average precision are the dollar amount 
estimates for impacts for both subgroups in Butte and the not-in-need subgroup in Tulare. 

As was the case for AFDC-FG registrants, the mix of AFDC-U subgroups differed across 
counties. Los Angeles again had the highest proportion determined to need basic education (92,2 
percent); Butte again had the lowest (57.7 percent). In every county, the percentage in need was 
larger in the AFDC-U sample than in the AFDC-FG sample. In some counties, the AFDC-U samples 
incl^'ded a particularly large proportion of refugees and others who were not proficient in English and 
whom GAIN slated for the ESL component of basic education. 

The three-year impact estimates presented in Tables 6.4 and 6.5 show that both earnings gains 
and welfare savings were generally larger for the not-in-need subgroup, a pattern that, at least for 
earnings gains, was similar to the one found for AFDC-FG registrants. Earnings impacts were larger 
for the not-in-need subgroup in Butte, Riverside, and San Diego; and, in those counties, there were 
statistically significant earnings impacts only for the not-in-need subgroup (first-year impacts were sta- 
tistically significant in San Diego, but second- and third-year impacts and the cumulative total were 
not). Only in Los Angeles was the pattern reversed, with earnings impacts being larger for the in-need 
subgroup and statistically significant only for that subgroup. The not-in-need subgroup in Los Angeles 
was quite small, however. Statistically significant three-year AFDC reductions were found only in 
Butte and Riverside for the not-in-need subgroup, although AFDC reductions for year 1 were 
statistically significant in Los Angeles and San Diego. In three of those four counties (all but Butte), 
statistically significant three-year AFDC savings were found for the in-need subgroup. In Butte, Los 
Angeles, and Riverside, however, the dollar savings were larger for the not-in-need subgroup; in San 
Diego, the savings were larger for the in-need subgroup. 

In Tulare, neither subgroup had statistically significant impacts on earnings or AFDC payments. 
The earnings impacts that appeared in year 3 for tlie not-in-need subgroup were not statistically 
significant and were offset by negative effects on the in-need subgroup. Differences between educa- 
tional need subgroups do not account for the absence of overall program impacts for AFDC-Us in that 
county. 

B. Other Subgroup s 

Table 6.6 presents third-year impacts on earnings and AFDC payments by county for a number 
of other subgroups. These subgroups were defined the same way for AFDC-Us as they were for 



^Differences in earnings gains between educational need subgroups were statistically significant in all 
counties except Tulare. Differences in AFDC savings were statistically significant in Alameda and Butte. 
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AFDC-FGs. Sample size limitations, discussed in Chapter 4, should be kept in mind. They are 
generally even more severe than for AFDC-FGs. Notably, none of the subgroup impacts estimated 
for Alameda should be considered reliable. Some of the discussion around other counties is also based 
on unreliable estimates. Third-year impacts were chosen because they make a substantial contribution 
to cumulative three-year impacts and are the most important indicators of the likely path of future 
impacts. 

Two questions are addressed in examining year 3 results for these subgroups. Were the overall 
results for AFDC-Us limited by GAIN'S not having produced impacts for any particular subgroup or 
subgroups? Does the subgroup composition of the county caseloads explain why Butte, the county with 
the largest three-year earnings impacts for AFDC-Us, performed as well as it did? In analyzing the 
results, estimated subgroup impacts in year 3 will frequently be compared to the all-county average 
impact estimates for year 3: approximately $350 in earnings gains and $300 in AFDC savings (see 
Table 6.1). 

To preview the findings: No clear evidence was found that any particular subgroup or subgroups 
limited the impacts of GAIN for AFDC-Us. Almost all of the subgroups examined had statistically 
significant year 3 impacts on earnings or AFDC payments in at least one county, or had impacts in 
at least one county that, while not statistically significant, were larger than the year 3 all-county 
average impact. At the same time, subgroups that showed large impacts in one county generally did 
not show large impacts in all of them. The evidence indicates, therefore, that the magnitude of 
impacts for AFDC-Us in year 3 did not result from the performance of different AFDC-U subgroups 
but, rather, from the characteristics of AFDC-Us in general or from aspects of GAIN that were present 
in most of the county programs. 

As to the second question, the relatively large earnings impacts for Butte appear to have resulted 
in part from the subgroup composition of its caseload, but also from the county's superior performance 
with some, thougli not all, of its subgroups. Butte's AFDC impacts were also the largest among the 
counties in year 3 (although they were not statistically significant). This, again, appears to have 
resulted from Butte's having produced, for a sizable share of its research sample, impacts that were 
larger than those produced for the same subgroups by the other counties. 

Each of the two questions central to this section will jiow be addressed in more detail. 

First, was GAIN'S performance for AFDC-Us limited by particular subgroups? Most sections 
of Table 6.6 are arranged so that subgroups for whom it might be suspected it would be difficult to 
achieve impacts are listed toward the bottom. (The ethnic subgroups, however, are simply listed in 
the order in which they appear in tables summarizing the characteristics of the research sample.) 
Among these are subgroups with longer AFDC histories or less recent employment; subgroups with 
potential language or cultural barriers; subgroups who were already participating in an education or 
training program at the time they were randomly assigned; and subgroups with larger families (and, 
hence, a higher ratio of AFDC benefits to potential earnings). 

Subgroups with a long welfare history or without recent employment did not necessarily have 
the smallest impacts, however. For example, "long-term recipients" had AFDC reductions exceeding 
$300 in every county except Tulare, and these impacts were statistically significant in two counties. 
Sample members without recent employment and sample members classified as "more disadvantaged 
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recipients" had statistically significant earnings gains and AFDC reductions in some counties, and their 
impacts were greater than the all-county average in several counties. 

Among AFDC-U etbiiic subgroups, sample sizes for blacks were too small to yield generally 
reliable results. Some above-average or statistically significant impacts were found for both Hispanics 
and those in the Asian/other category. Sample members with limited English proficiency and refugees 
obtained statistically significant earnings impacts in Los Angeles, where they were most numerous and 
constituted two-thirds of the research sample. These subgroups had large and statistically significant 
AFDC impacts in Riverside, although they made up only about one-eighth of the sample there. 

Sample members who were participating in an education or training program at the time of 
GAIN orientation (i.e., at the time of random assignment) were few in number - under one-fifth of 
the sample in all counties. Thus, their contribution to the overall county impact would be small, in 
proportion to their numbers. Nevertheless, this subgroup obtained statistically significant earnings 
impacts in Butte and above-average earnings (not statistically significant) impacts in one of the other 
counties (Tulare) that did not have very small samples for this subgroup. This subgroup also showed 
above-average, though not statistically significant, AFDC impacts in San Diego and Tulare. 

AFDC-U sample members with three or more children made up the largest subgroup based on 
number of children in every county, accounting for about two-thirds of the samples in Alameda and 
Los Angeles; half of the samples in Riverside, San Diego, and Tulare; and about 40 percent of the 
sample in Butte. In comparison, this group never made up more than about a third of any county 
sample among AFDC-FGs. Impacts on this subgroup could therefore have exerted considerable 
influence on the magnitude of impacts for the full AFDC-U sample. This subgroup did not have 
consistently lower impacts than the other subgroups defined by number of children. In Butte, the 
subgroup had larger earnings impacts than the subgroup with one child, although the estimate, was not 
statistically significant. In Los Angeles, the subgroup with three or more children had statistically 
significant earnings impacts, exceeding both the all-county average and the other two subgroups in that 
county based on number of children. The subgroup with three or more children obtained statistically 
significant AFDC impacts in Los Angeles and above-average AFDC impacts in San Diego. 

The second key question for this section is: Did Butte obtain large impacts owing to the 
subgroups with which that county worked? In analyzing the AFDC-U impacts in Butte, the most 
interesting subgroup breakdown is by "level of disadvantage." The Butte sample had a much higher 
proportion of first-time and returning applicants than did any other county: 42 and 34 percent of the 
Butte sample, respectively, and together constituting 76 percent of that sample. In no other county 
was there more than a 15 percent share of first-time applicants, and in no other county did the two 
applicant subgroups combined exceed 42 percent. Butte also had a much lower percentage of "more 
disadvantaged recipients" than any otlier county: about 6 percent of its sample. 

As shown in Table 6.6, among "level of disadvantaged" subgroups, Butte's largest year 3 
earnings impact was for first-time applicants: $1,763 (statistically significant). For this subgroup. 
Riverside had an earnings impact close to Butte's and also statistically significant; and San Diego had 
an earnings impact of over $1,(XK), although the estimate was "unreliable" and was also not statistically 
significant. In Tulare, this was the only subgroup that exceeded the all-county average earnings 
impact, although Tulare's impact was also "unreliable" and not statistically significant. This array of 
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results suggests that part of the reason Butte obtained large earnings impacts was that it had a large 
number of first-time applicants, 

Butte also had large earnings impacts for its other big "level of disadvantage" subgroup: 
returning applicants. Those gains in year 3 were $1,365, although the effect was not statistically 
significant. This impact was much larger than the earnings impacts for the other counties, Butte also 
had earnings gaias of more than $1,000 for "less disadvantaged recipients," again more than twice the 
impacts achieved for this group by the next nearest county (Riverside), although the Butte estimate 
should be considered unreliable owing to sample size, Butte did not obtain earnings impacts for the 
"more disadvantaged recipients," but the small size of this subgroup prevented it from having much 
effect on the overall Butte impact. 

As shown in Table 6,1, Butte was the county with the largest AFDC impact in year 3, although 
that result was not statistically significant, and the county did not have the largest AFDC impact for 
the three-year follow-up as a whole. None of the "level of disadvantage" subgroups obtained 
statistically significant AFDC impacts in Butte, but all of them produced effects exceeding the all- 
county average. For the "less disadvantaged recipients," who were the largest subgroup in Riverside 
and San Diego and were also large in Los Angeles, Butte obtained AFDC impacts that were more than 
three times the size of any achieved elsewhere, although the size of the impact in Butte is based on 
a small sample. Thus, the magnitude of the year 3 AFDC impact in Butte was associated with the 
consistency of that county's AFDC impacts across the four "level of disadvantage" subgroups and also 
with its larger impacts for the one subgroup among the four that was particularly important elsewhere, 

VIIL Other Outcomes 

This section examines program impacts on Food Stamp receipt and Food Stamp payments, and 
on combined income from earnings, AFDC payments, and Food Stamp payments. Methodological 
issues related to these outcomes are discussed in Chapter 4, and that discussion is not repeated here, 

A. Food Stamps 

Table 6,7 shows estimates of Food Stamp receipt and Food Stamp payments for AFDC-U 
sample members in the six GAIN research counties, A discussion of the Food Stamp data and analysis 
issues may be found in Chapter 4, As was the case for AFDC-FGs, a decreasing percentage of 
controls received Food Stamps over time, but the average dollar amounts of Food Stamps received 
increased over time. (See Chapter 4, Section VIIIA for a note on this issue,) Food Stamp payments 
for AFDC-U controls were slightly larger relative to their AFDC payments than they were for 
AFDC-FG controls, amounting to just under a quarter of the AFDC payments. 

Impacts on Food Stamps for AFDC-Us were larger than for AFDC-FGs, As shown in Table 
6,7, cumulative three-year Food Stamp reductions of more than $250 per sample member were 
obtained in four counties, and the effects were statistically significant in two, Los Angeles and 
Riverside had the largest dollar impacts, about $350 per sample member. The ^argest percentage 
change in Food Stamps, relative to control group Food Stamp payments, was in Riverside: a 9,7 
percent reduction. The all-county average Food Stamp impact over the three years was $222, which 
was statistically significant and totaled more than twice the all-county average for AFDC-FGs, This 
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TABLE 6.7 



GAIN'S THREE- YEAR IMPACTS ON FOOD STAMP RECEIPT BY AFDC-U REGISTRANTS 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Alameda 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =182) 



97.6 
94.5 
88.7 
71.7 

2047 
2281 
2245 
6573 



96.9 
93.3 
90.5 
85.0 



2076 
2378 
2455 
6908 



0.7 
1.2 
-1.8 
-13.3 



-29 
-96 

-210 
-335 



0.7% 
1 .3% 
-2.0%* 
-15.6% 

-1.4% 
-4.1% 
-8.6% 
-4.9% 



Butte 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1006) 



89.1 
64.6 
55.0 
51.0 



1184 
1150 
1213 
3547 



87.6 
68.0 
59.0 
56.3 



1256 
1226 
1338 
3820 



1.5 
-3.4 
-4.0 
-5.3 



-72 
-76 

-125 
-273 



1 .7% 
-5.0% 
-6.9% 
-9.4% 

-5.7% 
-6.2% 
-9.4% 
-7.2% 



Los Angeles 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total = 1458) 



94.0 
86.0 
83.0 
77.6 



2017 
2186 
2307 
6510 



97.0 
91.1 
84.5 
78.7 



2159 
2300 
2403 
6862 



-3.0 *** 
-5.1 *** 
-1.5 
-1.1 

-143 *** 
-114 ** 
-95 

-352 *** 



-3.1% 
-5.6% 
-1.8% 
-1.4% 



-6.6% 
-5.0% 
-4.0% 
-5.1% 



Riverside 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =2323) 



88.6 
56.0 
51.6 
47.0 



1125 
1074 
1139 
3338 



91.0 
59.2 
50.3 
47.6 



1261 
1174 
1260 
3695 



-2.5 
-3.1 
1.2 
-0.6 



-136 *** 
-100 ** 
-121 ** 
-357 *** 



-2.7% 
-5.3% 
2.4% 
-1 .3% 

-10.8% 
-8.6% 
-9.6% 
-9.7% 



(continued) 
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TABLE 6.7 (continued) 



County and Outcome 



Experimentals 



Controls 



Difference 



Percentage 
Change 



San Diego 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total =3272) 



93.9 
66.1 
61.3 
57.6 



1297 
1270 
1399 
3966 



92.7 
71.5 
62.0 
57.4 



1387 
1360 
1390 
4137 



1.2 
-5.4 *** 
-0.7 

0.1 



-90 *** 
-90 ** 

10 
-171 



1 .3% 
-7.5% 
-1.2% 

0.3% 

-6.5% 
-6.6% 
0.7% 
-4.1% 



Tulare 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Years 

Total (years 1 -3) 
Sample size (total-1901) 



94.8 
74.8 
68.1 
64.1 



1485 
1499 
1631 
4615 



94.9 
72.9 
67,7 
64.4 



1441 
1504 
1626 
4571 



-0,1 
1.9 
0.4 

-0.4 



44 

-5 
5 
44 



-0.1% 
2.7% 
0.5% 

-0.6% 



3.1% 
-0.3% 
0.3% 
1 .0% 



All counties (a) 

Ever received any Food Stamps (%) 
Any quarter, years 1 -3 
Last quarter of year 1 
Last quarter of year 2 
Last quarter of year 3 

Average value of Food Stamps ($) 
Year 1 
Year 2 
Year 3 

Total (years 1 -3) 
Sample size (total=9960) 



92.1 
69.5 
63.8 
59.4 



1422 
1436 
1538 
4395 



92.6 
72.6 
64.7 
60.9 



1501 
1513 
1603 
4617 



-0.6 
-3.0 *** 
-0.9 
-1.4 

*** 
*** 

-65 ** 
-222 *** 



-0.6% 
-4.2% 
-1.5% 
-2.4% 

-5.3% 
-5.1% 
-4.1% 
-4.8% 



SOURCE: MDRC calculations from county Food Stamp records, 

NOTES: See Table 6.1, 

(a) In the all-county averages, the results for each county, except Alameda, are weighted equally. 
Alameda is excluded because its AFDC-U impacts are based on a very small sample. 
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effect was about one-fifth of the three-year impact on AFDC payments, a higher ratio than for 
AFDC-FGs. The impact amounted to a 4.8 percent saving relative to the control group average, and 
this percentage saving was about four-fifths tht percentage saving in AFDC payments. 

It is not clear how long the experimental-control difference in Food Stamps will persist. 
Impacts in Los Angeles and San Diego that were statistically significaiit at the beginning of the follow- 
up period were no longer statistically significant, and were much smaller, by year 3, In Riverside, 
the dollar effects held up in year 3, but reductions in the percentage receiving Food Stamps fell over 
the diree-year period to about zero in year 3, suggesting that dollar impacts may decline after year 3. 
On the other hand, dollar impacts appeared to be rising in Butte and for the small sample in Alameda. 

B. Combined Income from Earnings. AFDC Payments, and Food Stamp Payments 

Table 6.8 presents impacts on eamings/AFDC/Food Stamp income and its components for the 
six GAIN research counties in the last quarter of foUow-up (quarter 13). There was little impact on 
eamings/AFDC/Food Stamp income for AFDC-Us. As; shown in Table 6.8, only Butte showed a 
positive effect: a $153 gain, not statistically significant, but amounting to a 6.4 percentage change 
relative to the control group average. All the other counties showed zero or slightly negative effects, 
none of them statistically significant. For the pooled sample of five counties (weighted equally), the 
average impact was only a 0.2 percent gain in eamings/AFDC/Food Stamp income (relative to 
controls), which was not statistically significant, either. 

Table 6.8 also shows the percentage of experimental and controls receiving income from the 
three sources. There was no clear pattern of effects. In Butte, there was a shift from welfare to work: 
from the category "AFDC without earnings" to "earnings without AFDC." In Los Angt'os, however, 
there was an increase in the percentage of experimentals who found jobs and remained on . vFDC. The 
decrease of 8.3 percentage points in the category "AFDC without earnings" was offset by an 8.8 
percentage point increase in the category "earnings and AFDC." This suggests an increase in part-time 
employment, which explains why employment impacts in Los Angeles were larger than earnings 
impacts and why there were AFDC savings without a reduction in the percentage receiving AFDC. 
The measured increase in the category "earnings and AFDC" is, however, also consistent with employ- 
ment at low earnings levels for some AFDC-U sample members or with a switch from AFDC-U to 
AFDC-FG status for their welfare cases. In Riverside, there was also an increase in the category 
"earnings and AFDC," which again corresponds to the finding that impacts on AFDC payments (i.e., 
AFDC savings) exceeded impacts on AFDC receipt (i.e., decrease in the percentage of people 
receiving AFDC), 



IX. The Riverside Case Management Experiment 

Table 6.9 presents the results for AFDC-Us in the Riverside case management experiment. 
These results parallel those for the AFDC-FGs, which were discussed in Chapter 4. They show no 
additional impact on earnings from enhanced case management services, but a possible small initial 
increase in AFDC reductions, which faded over time. 

Both "enhanced" and "regular" experimental group members experienced large impacts on 
employment in follow-up years 1 and 2, with the effect tapering off in year 3. There was virtually 
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TABLE 6.8 



GAIN'S IMPACTS ON TOTAL EARNINGS/ AFDC/ FOOD STAMP INCOME AND INCOME SOURCES 
IN THE LAST QUARTER OF YEAR 3 FOR AFDC-U REGISTRANTS 



County and Outcome 


Experimentals 


Controls 


Difference 


Percentage 
Change 


Alameda 










Average total value of AFDC. Food Stamps, 
and earnings in quarter 13 ($) 


2543 


2793 


-250 


-9.0% 


Income sources (%) 
earnings wiinoui Mruv^ 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


7 Q 

12.3 
54.8 
25.0 
100.0 


7 ^ 
4.8 
74.9 
12.8 
100.0 


V.*T 

7.5 * 
-20.1 *** 
12.2 ** 




Food Stamps without AFDC or earnings 
No Food Stamps. AFDC, or earnings 


5.8 
19.2 


2.8 
10.0 


3.0 
9.2 * 




Sample size (total =182) 


96 


86 






Butte 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


2538 


2385 


153 


6.4% 


Income sources (%) 
earnings wiLnoui Mruo 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


11.3 
36.7 
31.2 
100.0 


16.9 
10.7 
42.0 
30.4 
100.0 


4.0 
0.6 
-5.3 
0.8 




Food Stamps without AFDC or earnings 
No Food Stamps. AFDC. or earnings 


2.5 
28.7 


2.0 
28.4 


0.4 
0.3 




Sample size (total =1006) 


780 


226 






Los Anqeles 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


2765 


2758 


7 


0.3% 


Income sources (%) 
earnings wiirioui r\ru\^ 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


R Q 

23.6 
54.7 
15.7 
100.0 


4.7 
14.9 
63.0 
17.5 
100.0 


1 .3 

8.8 *** 
-8.3 *** 
-1.7 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


1.0 
14.7 


1.3 
16.2 


-0.2 
-1.5 




Sample size (total=1458) 


735 


723 






Riverside 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 13 ($) 


2063 


2091 


-28 


-1.4% 


Income sources (%) 
Earnings without AFDC 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


19.6 
11.5 
31.1 
37.8 
100.0 


20.6 
7.9 
33.0 
38.5 
100.0 


-0.9 

3.6 ** 
-1.9 
-0.7 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


6.0 
31.8 


6.7 
31.8 


-0.7 
-0.0 




Sample size (total =2323) 


1590 


733 
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TABLE 6,8 (continued) 



County and Outcome 


Experimentals 


Controls 


Difference 


Percentage 
Change 


San Dieqo 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


2624 


2712 


—88 


—3.2% 


Income sources (%) 
Earnings without AFDC 

E.CII 1 111 IU9 cit i\j r>nL^v>y 

AFDC without earnings 

InO MrUO diiU nu cdliliiiyb 

Total 


17.5 
17.1 
39.9 

100.0 


18.6 
15.5 
41.7 

OA 

100.0 


— 1 .0 
1.6 
-l!8 

I .o 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


1 .7 
23.8 


1 .9 
22.4 


-0.2 
1.4 




Sample size (total =3272) 


2427 


845 






Tulare 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


2729 


2749 


—20 


—0.7% 


Income sources (%) 
Earnings without AFDC 

tZdrriiriyb dtlU r\rU\^ 

AFDC without earnings 
i\0 Aruo ana no earnings 
Total 


20.0 
^R 9 

45.3 
I y .D 
100.0 


17.6 
44.8 

OO R 

100.0 


2.4 
0.1 
0.4 




Food Stamos without AFDC or earninas 
No Food Stamps, AFDC, or earnings 


2.0 
17.6 


2.9 
19.6 


-0.9 
-2.0 




Sample size (total=190l) 


1319 


582 






All counties (a) 










Average total value of AFDC, Food Stamps, 
and earnings in quarter 1 3 ($) 


2544 


2539 


5 


0.2% 


Incoine sources (%) 
Earnings without AFDC 
Earnings and AFDC 
AFDC without earnings 
No AFDC and no earnings 
Total 


16.8 
15.7 
41-5 
26.0 
100.0 


15.6 
12.8 
44.9 
26.6 
100.0 


1 .1 

2.9 *** 
-3.4 *** 
-0.7 




Food Stamps without AFDC or earnings 
No Food Stamps, AFDC, or earnings 


2.7 
23.3 


3.0 
23.7 


-0.3 
-0.4 




Sample size (total =9960) 


6851 


3109 







SOURCE: See Tables 6.1 and 6.7. 

NOTES: See Table 6.1. 

(a) In the all-county averages, the results for each county, except Alameda, are weighted equally. 
Alameda is excluded because its AFDC-U impacts are based on a very small sample. 
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no difference in employment impacts between the two experimental groups at any point. Also, the 
enhanced case management group did not show larger earnings impacts. In fact, the dollar amount 
of the three-year impact was larger for the experimental group that received regular case management 
services, although the difference between the two experimental groups was not statistically significant. 

Both experimental groups showed impacts on the percentage receiving AFDC and on AFDC 
payments in year 1. The effects were somewhat larger for the enhanced case management group, but 
the differences were not statistically significant, and they narrowed in year 2 and almost entirely 
disappeared by year 3. The cumulative three-year AFDC impact for the enhanced case management 
group was about 20 percent larger than for the regular case management group, but that difference was 
not statistically significant. 

The explanation for the absence of additional impacts from reduced caseloads that was suggested 
for AFDC-FGs applies to AFDC-Us as well: The Riverside sample was less likely to stay on AFDC 
a longer time than samples in other counties. AFDC-U controls in Riverside had a much lower 
percentage on AFDC at the end of year 3 than controls in any other county (see Table 6.1). The 
additional case management services for the enhanced case management group in Riverside may have 
gone to sample members who would have been off AFDC in the short run even witiiout GAIN. It is 
possible that extra staff attention might increase impacts if it could be targeted to program registrants 
who are likely to still be on AFDC and unemployed after having received the standard level of case 
management services. 



CHAPTER? 
BENEFIT-COST ANALYSIS 



This chapter provides a comprehensive benefit-cost analysis of the GAIN program in the six 
counties studied. Drawing on the analysis of net costs presented in Chapter 3 and the analysis of 
gain's impacts presented in Chapters 4 and 6, it provides an overall accounting of the financial gains 
and losses produced by the program from the perspectives of GAIN sample members, government 
budgets, taxpayers, and society as a whole. The analysis of benefits, like the study of impacts, 
includes experimental-control differences in the value of earnings, AFDC, and Food Stamps, 
However, the analysis goes beyond these basic impact measures to consider GAIN'S effects on fringe 
benefits from employment, the value of output produced in unpaid work experience jobs, taxes. 
Unemployment Insurance (UI) benefits, Medi-Cal (California's Medicaid program), and the cost of 
administering transfer programs. Cost estimates include the net costs of providing GAIN and non- 
GAIN employment-related services to experimental , As in Chapter 3, net costs were estimated by 
subtracting tlie average value of resources used by controls from the corresponding average for 
experimentals. The chapter presents separate benefit-cost estimates for each county as well as a single 
estimate for the program as a whole. 

The chapter begins by describing the scope of the analysis and the framework used. The next 
sections examine GAIN'S effects on earnings, fringe benefits, taxes, and transfer payments for the full 
AFDC-FG sample. These effects are then added together to produce a single measure of GAIN'S 
benefit-cost results for each of the perspectives listed above. The chapter concludes with a brief 
discussion of the results for the two basic education subgroups within the AFDC-FG sample and for 
the AFDC-U sample. 

1. Analytical Approach 

This assessment uses an analytical approach similar to that used in MDRC's previous 
evaluations of welfare-to-work employment programs,^ although it introduces additional distinctions 
because of the complexity of the GAIN program. The analysis places dollar values on the program's 
effects and its use of resources. It includes both measured effects on earnings, AFDC payments. Food 
Stamps, and Unemployment Insurance benefits and imputed effects on fringe benefits, state and federal 
taxes, Medi-Cal payments, and the costs of administering transfer programs. The analysis uses 
earnings and transfer payment records in combination with transfer payment eligibility rules, tax 
regulations, published data from state and federal agencies, and other sources to calculate imputed 
values. 

The primary benefit-cost estimates presented in this chapter cover a five-year time horizon 
starting with the first quarter after the quarter of random assignment (quarter 2), a time frame similar 



^Many of the techniques were developed for the evaluations of state programs in MDRC's Demonstration 
of State Work/Welfare Initiatives, See Long and Knox. 1985, for additional information. 



to the one used in most previous MDRC evaluations of we If are- to- work programs.^ It should be 
noted, however, that five years may not be long enough to capture the total effects of GAIN, In 
several counties, experimentals continued to show earnings gains and welfare savings at the end of the 
three-year follow-up - as did members of the early cohort at the end of year 4. Therefore, it is 
reasonable to expect that benefits will accrue beyond five years. In fact, in some counties and for some 
measures, GAIN'S effects may grow larger over time. Further, it may be particularly useful to 
estimate GAIN'S effects over a longer time frame in counties that made heavy upfront investments in 
basic education, such as Alameda and Tulare, or, in the case of Tulare, where earnings gains first 
appeared late in the follow-up. The chapter addresses this issue by briefly considering GAIN'S 
benefits and costs over a 10-year time frame (see Section IV), However, these estimates are much 
more tentative than the five-year results and should be treated only as reasonable guesses about the 
course of future effects. 

The five-year time horizon includes an observation period and a projection period. The 
observation period for each sample member encompassed the portion of follow-up when benefits were 
estimated (or imputed) directly from "observed" - i.e., recorded - earnings and transfer payments 
data. It extended from quarter 2 through the last month of available data (June 1993) and covered 
three to five years, depending on the sample member's date of random assignment, (It should be noted 
that 54 percent of AFDC-FGs and 58 percent of AFDC-Us had at least four years of follow-up in the 
observation period.) Gains and losses observed at the end of this period were then projected to the 
end of year 5, using several assumptions about the size of future effects. This projection period ranges 
from zero to two years, although, as suggested above, most sample members have only a year or less 
of projected data. In general, benefit-cost estimates based primarily on observed data, such as the ones 
presented in this chapter, are more reliable (i.e,, less affected by assumptions) than estimates involving 
a longer projection period. 

The main findings of the analysis are expressed in terms of net present values per experimental 
sample member, "Net" means that the amounts represent differences between experimentals and 
controls, just as imi^^cts do, "Present value" is an accounting method for estimating the worth today 
of dollar effects that occur in the future. 

In a welfare-to-work program such as GAIN, most costs are incurred early on, particularly in 
the first two years, when service use is heaviest, while many benefits (e,g,, earnings gains and welfare 
savings) are realized in later years. However, simply comparing the nominal dollar value of program 
costs and benefits would be problematic. The value of a dollar is greater in the present than in the 
future: a dollar available today (either to experimentals or to the government) can be invested and 
produce income over time, making it worth more than a dollar available in the future. Thus, to make 
a fair comparison between costs and benefits, it is essential to focus on their value at a common point 
in time - i.e., in the present. 

The benefit-cost analysis addresses this issue by discounting, i.e., by adjusting the value of 
benefits accruing after the program "investment period" to reflect their lower value in terms of the time 



^The five-year time frame \vas originally chosen for estimating the costs and effects of short-term, job- 
search-oriented programs, where effects were expected to occur quickly and then decrease over time. 
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when program costs were incurred. In effect, an estimated amount of interest income foregone must 
be subtracted from the nominal value of the benefits occurring after the investment period.-^ 

This report uses the end of quarter 5 as the comparison point for the investment period, since 
it is about mid«way in the period in which most program costs were incurred. (See Chapter 3.) Thus, 
gains accrued later were discounted to reflect their value at the end of quarter 5. In calculating these 
discounted values, it was assumed that a dollar invested at the end of quarter 5 would earn a real rate 
of return of 5 percent annually/ Furthermore, all benefits and costs are expressed in 1993 dollars, 
eliminating the effects of inflation. 

Once estimated, particular net benefits and net costs will constitute gains or losses, or be 
irrelevant, depending on which of the analytical perspectives - the welfare sample, the government 
budget, taxpayers, or society - is considered.^ The welfare sample perspective identifies net gains 
or losses for members of the experimental group, indicating how they fared as a result of the 
program.^ As illustrated by the in-text box that follows shortly, earnings impacts represent gains for 
the welfare sample, while reductions in AFDC (and other transfers) represent losses,^ Higher taxes 
paid by experimental compared to controls also constitute losses to the welfare sample. In essence, 
a program produces a net gain from the standpoint of the welfare sample if experimental' earnings 
gains exceed the value of reductions in transfer payments and higher taxes. ^ The net costs of 
providing employment-related services to experimental have no direct effect on their income and are 
not considered as net gains or losses from the perspective of the welfare sample. Similarly, any 
budgetary savings in administering transfer programs have no direct effect on the welfare sample. 



^Put differently, a benefit occurring at time 2 has tiie same value as a smaller benefit occurring at time 
1 plus interest; thus, subtracting the interest income from the time 2 benefit yields its value at time L 

"^For example, if a welfare-to-work program increased revenues to the government budget by an average 
of $1,221 per experimental in the last quarter of year 5, its net present value would be $1,000 from the 
standpoint of the investment period. That is because $1,000 invested at the end of quarter 5 at a 5 percent 
annual rate of interest (compounded continuously) equals $1,221 at the end of year 5, 

^See Friedlander and Gueron, 1991, and Friedlander and Hamilton, 1993, for other examples of these 
analyses. 

^It is important to note that the analysis does not take into consideration any effect GAIN may have had 
on any "under the table" earnings of experimentals. It also does not distinguish (or make any value judgments 
about) reductions in AFDC payments resulting from sanctions for noncompliance versus reductions owing to 
increased earnings or to case closures without earnings or sanctions; it counts all reductions in AFDC 
payments as losses to the welfare sample and savings for government budgets. 

^In this analysis, net increases in support service payments to expeiimentals are not considered to be gains 
from the perspective of the welfare sample. These payments for child care, transportation, and ancillary 
expenses simply offset additional costs to experimentals resulting from GAIN'S participation requirements. 
However, the analysis does include these payments as costs incurred from the government budget and taxpayer 
perspectives. 

^It follows that one program may produce higher earnings gains than another, but that the second may still 
show more positive benefit-cost results from the standpoint of the welfare sample. This result will occur if 
the second program produces smaller welfare reductions and increases in tax payments than the first. See, 
e.g., the comparison of earnings gains and AFDC reductions recorded by the San Diego SWIM and Baltimore 
Options programs in Friedlander and Gueron, 1991, pp. 24-33. Put differendy, a program produces a net 
gain from the standpoint of the welfare sample if experimentals' total estimated income (the sum of earnings 
and transfer payments, plus the Earned Income Tax Credit, minus taxes) exceeds that of controls. 



The goveminent budget perspective identifies net gains and losses incurred by federal, state, and 
local governments combined. Net gains to the government budget occur through savings in transfer 
payments and their related administrative costs and through higher taxes paid by experimental 
compared to controls. The government budget comes out ahead to the extent that tax increases 
(resulting from earnings gains) and savings in transfer paym.ents and administrative costs exceed the 
net cost of providing employment-related services to experimentals. In and of themselves, 
experimentals' earnings gains do not affect the calculations of net gains or losses from the standpoint 
of the government budget. 

The taxpayer perspective identifies benefits and costs from the standpoint of everyone in society 
other than individuals in the AFDC sample.^ Estimates of net gains and losses from the taxpayer 
perspective closely resemble those of the government budget perspective. The two perspectives differ 
only in the treatment of Social Security and Medicare taxes and net gains from output that 
experimentals produce in unpaid work experience (iPREP) assignments,^^ Specifically, the 
government budget gains from both the welfare sample's and their employers' contributions to the two 
payroll taxes (i.e.. Social Security and Medicare), while taxpayers (who include employers) gain only 
from employee contributions. Also, only taxpayers gain from experimentals' output from unpaid work 
experience jobs. However, this effect was extremely small in GAIN because few experimentals 
participated in PREP and some controls also worked at unpaid work experience jobs in other 
programs. 

It should be noted that this analysis assumes that no displacement occurred as a result of 
employment gains by experimentals. Rather, because displacement could not be measured, it assumes 
that employment gains for experimentals represented an increase in the total level of employment and 
the value of output in each research county. Alternatively, one could assume that at least a portion 
of experimental' employment gains (and earnings increases) occurred because experimentals took jobs 
that would have gone to other members of society, leaving those individuals unemployed and possibly 
causing some of them to use government transfer programs. To the extent that this occurred, it would 
reduce the program's overall return for government budgets and taxpayers. 

As suggested by the above discussion, the results from the perspectives of the welfare sample, 
taxpayers, and the government budget may be complementary, or they may conflict. One group's 
gains may appear as another group's losses. The accompanying box helps to illustrate this point. 
Here, a reduction in AFDC use would translate into a loss for the welfare sample and a corresponding 
gain for the government budget and taxpayers. However, an increase in earnings would reflect a gain 
to the welfare sample, but not to the government budget — although any taxes paid on those earnings 
would be a gain for the government budget. The net cost of employment-related services (e,g., 
education and training), in contrast, would be a loss to the government budget while leaving the 
welfare sample unaffected. 



^The term taxpayer is used for convenience and for the sake of consistency between this analysis and 
previous benefit-cost analyses. It should be noted that all members of the experimental group pay sales taxes 
and that many pay income and Social Security taxes as well. 

^^ecause no wages or fringe benefits were provided in the PREP positions, the full value of that output 
went to the public (and nonprofit) agencies that employed GAIN participants, and tiaus to taxpayers as well; 
at the same time, this output is neither a gain nor a loss from the perspective of the government budget or the 
welfare sample. 
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Increase in income 
tax payments 


— 
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0 


Reduction in AFDC 
payments 






0 


Net cost of 
employment- 
related services 


0 







A welfare-to-work program might also produce net gains from the welfare sample, government budget, 
and taxpayer perspectives simultaneously, or net losses from all three perspectives.^^ When the 
results are mixed (i.e., positive from some perspectives but not from others), an overall assessment 
of the program's merits depends upon one's willingness to value one perspective m.ore highly than the 
others. Some will consider a program that increases the income of welfare recipients to be successful, 
even if taxpayers and the government budget realize some net loss. Others may judge a program as 
successful only if it produces budgetary savings. 

The final perspective, the perspective of society as a whole, combines tlie perspectives of the 
welfare sample and taxpayers (and the government budget). For a given component in the analysis, 
a net gain to society occurs only when a gain to one group is not at the expense of another group. For 
example, earnings gains for experimentals represent a gain to the welfare sample without affecting 
taxpayers; thus, they are counted as a net gain to society. Net losses to society occur when what is 
a loss from one perspective is not a benefit from another. For example, the net costs of services 
represent a loss to the taxpayers and government budget but do not affect welfare recipients. Program 
effects that constitute a net gain from one perspective but a net loss from another (such as AFDC 
savings) have no financial consequences from the social perspective — these effects, which represent 
a transfer from one group in society to another, simply cancel each other out. Thus, from the 
standpoint of society, a welfare-to-work program such as GAIN would be judged successful in benefit- 
cost terms if it produced earnings gains for the welfare sample (these do not affect the government 



^^A welfare-to-work program will produce net gains from all three perspectives when earnings gams 
exceed the reductions in transfer payments and increases in taxes (a net gain from the perspective of the 
welfare sample), and the reductions in transfer payments and administrative costs, combined with increased 
tax revenues, exceed the net cost of providing employment-related services (a net gain from the perspectives 
of taxpayers and the government budget). It is also possible for a program to produce net losses from all three 
perspectives (e.g., when welfare savings plus tax increases exceed earnings gains, but net costs are higher 
still). 
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budget or taxpayers) and savings in transfer payment administrative costs (these do not affect welfare 
recipients) that together exceed the net cost of services. It should be noted that, when adopting the 
social perspective, one assumes that the "value," or importance, of a dollar lost by one group is 
equivalent to that of a dollar gained by another group, which may or may not be a valid assumption. 

Some limits on the comprehensiveness of the benefit-cost analysis should also be recognized. 
In particular, the estimates below do not take into account possible displacement of other workers by 
any increased employment of experimentals or the clear but difficult-to-monetize benefits associated 
with society's preference for work over welfare. As is typical in benefit-cost analyses, certain effects 
cannot be quantified, and long-run effects cannot be gauged precisely. 

II. Program Effects (Benefits) for the Full Sample of AFDC-FGs 
A. Earnings 

Chapter 4 showed that the GAIN program led to increased work and earnings by AFDC-FG 
experimentals (compared to the control group) during a three-year follow-up period. The earnings 
impacts ranged from small in Los Angeles to large in Riverside. Table 7.1 presents the net present 
value of earnings gains over the entire observation period, which, as discussed above, included at least 
a year of additional follow-up (beyond year 3) for most of the sample. As the table shows, the 
earnings gain was $2,161 per experimental (in 1993 dollars) for all six counties combined, ranging 
from $388 in Los Angeles to $4,317 in Riverside. 

Fringe benefits - in the fonn of employer-paid health and life insurance, pension contributions, 
aixi worker's compensation associated with these earnings — were part of sample menibers' total 
compensation from working, and are included in the analysis. Using published data, these were 
estimated at the rate of 14.8 percent of wages. Thus, for all six counties combined, the average 



^^Society also benefits from increased output from employees in unpaid work experience jobs. 

^^Tables 7.1 through 7.4, like the cost and impact tables, show experimental-control differences as positive 
when the mean value for experimentals exceeds die mean value for controls and as negative when the control 
mean is higher. Tables 7.5 through 7.10, which incorporate the four analytical perspectives, use a different 
format for displaying benefit-cost results. In these tables, an effect has a positive value if it represents a net 
gain from the perspective in question and a negative value if it represents a net loss. Therefore, the same 
effect will appear positive in some tables and negative in others. 

^"^Eamings gains and reductions in AFDC and Food Stamps are discounted and expressed in 1993 dollars. 
Altliough not shown in any table, experimental-control differences in these measures differ from the value of 
impacts displayed in earlier chapters, even for the three-year follow-up, because of these transformations. 

^^U.S. Bureau of the Census, 1993, p. 430. The estimated value of fringe benefits was calculated as a 
ratio of the combined costs of employer-provided life and health insurance, retirement and pension accounts, 
and worker's compensation to the combined costs of regular wages, paid leave (e.g., vacation and sick days) 
and other benefits, which include severance pay, and supplemental (employer-provided) unemployment 
benefits. (Payments for leave time are captured directly by the earnings data and thus are not counted as a 
fringe benefit in this analysis.) The numerator in this ratio represented 12.0 percent of employer costs in 
1992, while the denominator represented 81.1 percent. Dividing the second term into the first yields the 
fringe benefit rate of 14.8 percent used in this analysis. Legally mandated employer contributions for Social 
Security and Medicare were treated as taxes and were included later in the analysis. 
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increase of $2,161 per experimental plus an additional $320 in fringe benefits yielded an average 
increase in total work-related compensation of $2,481 per experimental during the observation period. 

Tax Payments 

Since GAIN produced an increase in earnings, there were corresponding effects on federal and 
state income taxes, payroll taxes, and state sales and excise taxes. Tax rates and rules for 1991, 
including the Earned Income Tax Credit (EITC),^^ were applied to an appropriate income base to 
impute taxes from earnings and other income. The estimated increases in taxes paid by 
experimentals during the observation period are shown in Table 7.1. Total taxes increased by $205 
per experimental for the six counties combined. Social Security and Medicare payroll taxes accounted 
for most of the tax increase. Employers pay an "employer's share" of these payroll taxes, which 
matches the rate paid by their employees. Therefore, the same increase in these payments by 
employers ($165 per experimental for the six counties) was estimated for the a ■ lysis (but is not 
included in Table 7.1).^^ Interestingly, GAIN had practically no effect on the level or federal income 
taxes paid by experimentals despite their earnings gains. That is because many experimentals and 
controls owed no federal income taxes once the value of standard deductions and exemptions was 
subtracted from their taxable income. Experimentals also received larger EITC tax subsidies than 
controls, which further offset potential tax increases. 

C* Transfer Payments 

As described in Chapter 4, GAIN produced relatively large savings in AFDC and much smaller 
savings in Food Stamps during the common three-year follow-up. The benefit-cost analysis estimates 



^^e Earned Income Tax Credit (EITC) is a credit against federal income taxes foi taxpayers with annual 
earnings below a threshold level. As with other tax credits, each dollar of EITC reduces by a dollar the taxes 
owed. Eligible persons can receive EITC as a payment from the government if they owe no federal income 
taxes. Schedule Z EITC rates for 1991 were used in this analysis. For 1991, only taxpayers with dependent 
children and whose earnings ranged from $1 to $21 ,250 were eligible for EITC. Taxpayers who had two or 
more children and who earned between $7,140 and $1 1,250 received the maximum value of EITC, $1,235; 
those with only one child received up to $1 , 192. Taxpayers earning between $1 1 ,250 and $21 ,250 received 
a progressively lower value of EITC. Not all eligible taxpayers receive EITC. The EITC "take-up" rate was 
set at 70 percent based on findings from Scholz, 1994, and subsequent conversations with the author. The 
rate was applied to all sample members. That is, each sample member's earnings were used to calculate the 
value of EITC that she would have received; that amount was then multiplied by .7. 

^^Total earnings were used in computing federal and state income taxes for every sample member. 
Unemployment Insurance compensation was included in the base amount used in calculating federal but not 
state income taxes (since those benefits are not counted as taxable income under California income tax rules). 
The combined income from earnings, AFDC payments, and Unemployment Insurance compensation was used 
in calculating sales and excise taxes. 

The estimation of federal and state taxes used 1991 tax rates, exemption amounts, and Earned Income 
Tax Credit niles, since that year was about midway in the 1988-1993 period of data collection for the earnings 
and AFDC data analyzed in this report (see Table 1.1). 

^^Employer contributions do figure in the benefit-cost results from the perspective of the government 
budget. See Table 7.6. 

^^GAIN increased the amount of money received through the EITC by an estimated $1 1 8 per experimental 
for all six counties combined. The range was from $35 in Los Angeles to $266 in Riverside. 
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the effects of GAIN on these two transfer payments over five years and also considers its effects on 
Unemployment Insurance benefits, Medi-Cal payments, and the costs of administering these four 
transfer programs. This section discusses benefit-cost results during the observation period. As 
before, experimental-control differences are expressed in 1993 dollars and discounted to the end of 
quarter 5 to reflect a forgone opportunity to invest. 

As shown in Table 7,2, the GAIN program realized savings in AFDC in all counties except 
Tulare during the observation period, AFDC savings averaged $1,264 in the six counties combined 
and ranged from $946 in Alameda to $2,557 in Riverside, while Tulare produced a small net increase 
($42) to experimental. Observed savings in Food Stamps averaged $131 across the six counties. As 
shown in Chapter 4, four counties realized savings - here, ranging from $182 in San Diego to $316 
in Los Angeles, Compared to controls, experimental averaged slightly higher levels of Food Stamp 
receipt in Alameda and Tulare. 

Differences in unemployment compensation were measured using Unemployment Insurance 
records data. The overall experimental-control difference reported in Table 7,2 indicates that these 
payments increased by a small amount ($17 per experimental for the six counties during the 
observation period). Experimental-control differences in average Medi-Cal payments were imputed 
on the basis of observed differences in AFDC receipt and earnings, rules governing Medi-Cal 
eligibility, and published data on average Medi-Cal payments made to all eligible individuals. An 
individual on AFDC is automatically entitled to receive Medi-Cal and, under certain circumstances, 
is eligible to receive Transitional Medi-Cal for 12 months after leaving the AFDC rolls for 
employment.^^ 

The analysis estimates experimental-control differences for AFDC-related and Transitional 
Medi-Cal and then combines these effects into a single estimate of Medi-Cal savings. Imputing the 
value of Medi-Cal payments for AFDC recipients involves several steps. First, one estimates the 
average value of Medi-Cal dollars paid on behalf of the sample member's AFDC case during a typical 
month of Medicaid eligibility. This average is calculated by multiplying the average Medi-Cal monthly 
payment for a single adult or child on AFDC by tne number of adults and children on the sample 
member's case (as recorded at orientation), (The analysis used county- specific averages, which ranged 
from $59,40 in Tulare to $73.71 in Los Angeles during 1992,)^^ This average is then multiplied by 
the total number of months of AFDC receipt for each sample member, resulting in an estimate of total 
Medi-Cal expenditures for the observation period. Finally, the experimental-control difference in total 
payments is calculated, A similar strategy was used to estimate GAIN'S effects on Transitional Medi- 
Cal payments, 



^^Estimates of the value of Transitional Medi-Cal for the entire follow-up are based on eligibility rules 
in effect since April 1990, Former AFDC recipients and their families can receive up to 12 months of 
Transitional Medi-Cal if they lose AFDC eligibility because of increased earnings, increased hours of 
employment, or loss of earnings disregards, 

^^These averages were calculated from data in California Department of Health Services, California's 
Medical Assistance Program, Annual Statistical Report, Calendar Year 1992, Tables 21 and 23. 

Among the rules for determining eligibility for Transitional Medi-Cal is the basic requirement that a 
person receive earnings high enough to terminate her AFDC eligibility, (At the same time, a person would 
not be eligible for Transitional Medi-Cal if her gross monthly earnings less necessary child care costs 

(continued,,,) 
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As indicated in Table 7.2, the program achieved overall savings in Medi-Cal (regular and 
Transitional) of $231 for the six counties combined. All counties except Tulare spent fewer Medi-Cal 
dollars on experimentals during the observation period, with savings in the five counties ranging from 
$171 in Butte to $442 in Riverside. As expected, experimentals received somewhat higher levels of 
Transitional Medi-Cal on average, reflecting their gains in earnings as well as decreases in their AFDC 
receipt. 

Combining average savings in AFDC, Food Stamps, and Medi-Cal with the small increase in 
average Unemployment Insurance benefits yielded an average savings in transfer payments of $1,610 
for the six counties. Individual county averages ranged from a net increase of $180 in Tulare to a 
savings of $3,217 in Riverside. The other four counties achieved savings in transfer payments of more 
than $1,000 per experimentaL These savings, in turn, decreased the costs of administering transfer 
payments by an average of $139 per experimental. GAIN'S effects on transfer program administrative 
expenditures were estimated based on differences in use of the transfers and on information about state 
and federal program costs. (See Table 7,2.) 

D. Future Effects 

Thus far, only program effects during the observation period have been considered. However, 
as discussed above, these effects almost certainly will last beyond this period, an expectation that 
should be taken into account in the analysis. Effects are consequently projected for each sample 
member beyond what was actually observed, so that the measured and projected effects together cover 
five years from the first quarter of the follow-up period (quarter 2). As discussed above, most sample 
members have only a year or less of projected data, but the last cohort to enter the research has two 
years. 

Projecting program effects entails calculating a base period estimate and then making an 
assumption about how it will change in the future. This evaluation used data from each sample 
member's last four quarters of available follow-up to estimate GAIN'S base period effects. 
Assumptions then had to be made about the future effect of the program through the end of the five- 
year period. The main assumption for this analysis was simply that GAIN'S impacts on earnings will 
neither increase nor decrease during the projection period. This is a reasonable assumption, first, 
because it is the pattern suggested by the eariy cohort analysis presented in Chapter 4: In all counties. 



^^(... continued) 

exceeded 185 percent of the federal poverty level. However, this requirement was not considered m the 
analysis because most sample members earned less than that amount.) Because only quarterly earnings were 
available for the analysis, it was assumed that a sample member had met the earnings requirement in all three 
months of a calendar quarter if her earnings were at least three times the minimum level that, in a single 
month, would close her AFDC case. 

2^Combined federal, state, and local administrative costs for each of the four transfer payments were 
estimated as a percentage of the value of the payments, i.e., by dividing total administrative costs by total 
payments. The estimated percentages were 8.4 (AFDC), 13.9 (Food Stamps), 1 1.2 (Unemployment Insurance 
benefits), and 6.92 (Medi-Cal). Data for calculating these measures were obtained from tables in U.S. 
Department of Health and Human Services, 1994, and U.S. Congress, House Committee on Way and Means, 
1993, and communications with administrators in the U.S. Department of Labor, California Regional Office. 
^"^Sample m^ nibers randomly assigned prior to July 1988 had observed data through quarter 21. 
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the early cohon had quite similar or growing impacts on earnings in the quaners following the three- 
year common follow-up period (see Figure 4.2). Furthermore, some earlier studies of employment 
programs for welfare recipients have documented such a pattern and, in some cases, have indicated 
that program effects can actually increase over time.^^ 

However, for AFDC payments, the analysis assumed that GAIN'S impacts will decline in the 
future by about 15 percent per year. This, too, was based on the patterns observed for early cohorts 
in each county, as discussed in Chapter 4. For other outcomes, either no decay (i.e., diminution of 
impacts) or a 15 percent decay rate was assumed, depending on whether the type of outcome is related 
more to earnings or to AFDC payments. Thus, for Unemployment Insurance benefits and taxes, an 
assumption of zero decay was made, while for Food Stamps and Medi-Cal, a 15 percent decay rate 
was applied. 

The resulting estimates are presented in Table 7.3. The values of all program effects - both 
observed and projected — have been discounted at a 5 percent real annual rate and adjusted for 
inflation to reflect 1993 dollars. For all six counties combined, the projected effects, compared to the 
observed effects, represent a much smaller share of the five-year effects (e.g., about one-quarter for 
earnings). However, projected earnings gains exert a bigger influence on the five-year totals in 
Alameda and Tulare, primarily because earnings gains in these counties showed up late in the 
observation period. Moreover, sample members in these counties averaged fewer quarters of observed 
data. 

The projected effects do, of course, add some uncertainty to the overall five-year estimates. 
However, as Table 7.4 shows, making even more extreme assumptions about decay rates (e.g., up to 
40 percent per year) would not change the five-year estimates by very much. Consequently, which 
assumption is used would also not have much effect on the other outcomes (e.g., taxes and Medi-Cal) 
that are linked to these measures. 



IIL Comparing Benefits and Costs for the Full AFDC-FG Sample 

Tables 7.5, 7.6, and 7.7 and Figure 7.1 summarize GAIN'S monetary effects from the welfare 
sample and government budget perspectives. The analysis defines experimental -control differences 
as gains (indicated by positive values) and losses (indicated by negative values). Results are then 
added together to produce an estimate of net present value of the GAIN program from the perspective 
in question. A . indicated earlier, all estimates for society as a whole constitute the sum of the results 
for the welfare sample and taxpayer perspectives (the latter includes the government budget 
perspective). All results cover a five-year period, are discounted and expressed in 1993 dollars, and 
reflect the assumption of no decay for earnings- related impacts and a 15 percent per year decay rate 
for AFDC-related impacts during the projection period. 



^^For examples, see the evaluation of the National Supported Work Demonstration (Masters and Maynard, 
1981); the evaluation of a WIN job search program in Louisville, Kentucky (Wolfliagen, 1983); the evaluation 
of longer-term impacts of Options, a welfare employment program in Baltimore, Maryland (Friedlander, 

1987) ; and the evaluation of longer-term impacts of the Arkansas WORK Program (Friedlander and Goldman, 

1988) . 
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A. Results from the Perspective of the Welfare Samp le 



Table 7.5 and Figure 7.1 A present the benefit-cost results from the perspective of the welfare 
sample. It should be remembered that these results represent experimental-control differences in 
earnings and fringe benefits, taxes, and transfer payments. As discussed earlier, one estimates GAIN'S 
net present value from the perspective of the welfare sample by subtracting the combined value of tax 
increases and savings in transfer payments from the value of earnings gains and increased fringe 
benefits. As Table 7.5 and Figure 7.1 A show, GAIN experimental - with the exception of those 
in Los Angeles - experienced a net financial gain as a result of the program, averaging $923 per 
experimental for the six counties combined over the five-year period (The average net gain equals 
$1,420 when Los Angeles is excluded.) In Los Angeles, experimental' losses in transfer payments 
(especially in AFDC) exceeded their earnings increases and, as it turns out, a small decrease in taxes 
compared to controls, producing an overall negative net present value of —$1,561. In all other 
counties, experimentals realized an average gain of between $948 in San Diego to $1,900 in Riverside. 
It is noteworthy, however, that in Tulare, this positive result was achieved with a smaller earnings 
increase and a smaller reduction in AFDC payments compared to the other counties. In contrast. 
Riverside's results, compared to all of the other counties, reflect both a large increase in earnings and 
a large reduction in welfare payments ~ in other words, a greater substitution of work for welfare. 

One can also express these results in terms of the net gain or loss for experimentals for every 
net public dollar invested to provide them with employment-related services. This is calculated by 
dividing the net present value for the welfare sample by the government's net costs (see Table 7.6). 
This measure, net gain or loss (net present value) per net dollar invested^ presented in Table 7.5, 
indicates by how much experimentals were made financially better off (if at all) for every dollar 
invested in services for them above and beyond the cost of services received by controls. At the five- 
year mark. Riverside's program produced $1.19 in net gains for experimentals for every dollar of net 
public costs. Three other counties — Butte, San Diego, and Tulare - produced between $.50 and 
$.58 in net gains for experimentals per dollar of net costs. Alameda's experimentals gained $.19 per 
net dollar invested. As noted above, experimentals in Los Angeles incurred a net loss. Across the six 
counties, the GAIN program produced gains for experimentals averaging $.27 per net dollar invested. 
It should be remembered that the GAIN program will likely produce earnings gains for experimentals 
beyond year 5. Therefore, the ratio of net present value to net costs should become more positive. 

B. Results from the Perspective of the Govermnent Budget 

From the perspective of the govenmient budget, the story is mixed, as Table 7.6 and Figure 
7. IB shovv.*^^ In Alameda, Los Angeles, and Tulare, net costs incurred by the government exceeded 
savings in transfer payments and tax gains by a substantial amount, resulting in large net losses per 
experimental. Average net present values in these counties ranged from -$3,442 to -$2,261. The 
losses in Alameda and Los Angeles in particular reflect the comparatively high net expenditures on 
employment-related services per experimental. (See Chapter 3 for a full discussion of costs.) On the 
other hand. Riverside's GAIN program combined comparatively low net costs with relatively large 
budgetary savings and tax gains, producing a substantial net gain for the government budget ($2,936). 



^^he analysis does not include the experimental-control difference in transitional child care payments. 
However, the examination of available payments data suggests that very few experimentals or controls 
received these payments. 
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FIGURE 7.1 



GAIN'S BENEFIT-COST RESULTS FROM THE WELFARE SAMPLE AND 
GOVERNMENT BUDGET PERSPECTIVES FOR AFDC-FGs 
WITHIN FIVE YEARS AFTER ORIENTATION (IN 1993 DOLLARS) 



A. From the Welfare Sample Perspective 
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B. From the Government Budget Perspective 
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San Diego achieved a modest net gain ($767), and Butte's GAIN program did slightly better than break 
even. On average, across the six counties, the GAIN program incurred a net loss to the government 
budget of $833. 

One can also consider the cost-effectiveness of the GAIN program from the standpoint of the 
government budget by estimating the value of budgetary savings and tax increases per dollar of 
investment (i,e., per dollar of net costs). This measure is called return to budget per net dollar 
invested and is presented in Table 7.6. One calculates GAIN'S return to budget by adding together 
gains in taxes and savings in transfer payments and associated administrative costs and then dividing 
this total by total net costs of services (both GAIN and non-GAIN). According to this measure, 
government budgets come out ahead if the program p'-oduces more than a dollar's worth of additional 
revenues and savings for each additional dollar spent on employment-related services to experimentals 
(compared to controls). 

As seen in Table 7.6, Riverside's program produced $2.84 in increased revenues and savings 
for every additional dollar spent on experimentals ('jeyond the control group average), a substantial 
return to the budget .^"^ The GAIN program in San Diego ($1.40) also returned considerably more 
than a dollar in revenues and savings, while Butte's program essentially caused the government to 
break even ($1.02). On the other hand, Alameda, Los Angeles, and Tulare returned less than $.50 
per dollar of net costs; and the six counties on average returned $.76. (It should be noted that a return 
of less than one dollar per dollar invested is equivalent to a negative net present value from the 
government budget perspective.)^^ 

Once again, it should be noted that these benefit-cost results are estimated over a five-year 
period. It is likely that the net present values will improve in future years, although, even using 
relatively optimistic assumptions, the GAIN programs in Alameda, Los Angeles, and Tulare will 
probably not break even. (See Section IV.) One should also remember that these estimates assume 
that no displacement occurred as a result of employment ga^ns for experimentals. As previously 
discussed, including a displacement effect would lower the net present values from the government 
budget perspective. (However, one would have to assume quite large displacement effects, and that 
a large proportion of those displaced received AFDC and other government transfers, for the positive 
government budget effects in Riverside and San Diego to become negative. In contrast, the "break- 
even" result in Butte could become negative with relatively modest assumptions about displacement. 
In the other three counties, displacement effects would not change the qualitative conclusions of this 
analysis, i.e., that GAIN resulted in a net loss from the government budget perspective.) 



^■^The ratio of $2.84 returned per net dollar invested is calculated by dividing the $4,533 in combined 
savings in transfer payments and administrative costs plus tax increases by the $1,597 in net costs of GAIN 
and non-GAIN services to experimentals. The SWIM program, by comparison, returned $2.34 per dollar 
invested. 

^^When calculating net present value from the government budget perspective, net costs are subtracted 
from combined revenue increases and savings in transfer payments and administration. In net return to budget 
calculations, these gains are divided by net costs. Therefore, when net costs exceed gains, net present value 
will be less than zero and net return to budget will less than $1 . Net return to budget will be less than zero 
dollars when impacts are negative: i.e., when experimentals earn less on average than controls (and pay less 
in taxes) and receive more in AFDC and other transfer payments. 
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C. Results from the Perspective of Taxpayers and Society as a Whole 



The results from the taxpayer perspective are almost identical to those of the government 
budget. As discussed earlier in the chapter, taxpayers (i.e., defined for this analysis as everyone else 
in society other than the welfare sample), realized mostly the same benefits as the government budget. 
However, they received an additional gain from increased output from experimental employed in 
unpaid work experience (PREP) jobs. On the other hand, they benefited less firom increased payroll 
taxes. Although a precise value of output from PREP could not be estimated with the data available 
for this study, a reasonable approximation places it close to zero in Los Angeles, Riverside, and 
Tulare, because of its very limited use by sample members in this study (see Chapter 2). The 
experimentalK:ontrol difference in value of output was somewhat larger in Alameda ($77), Butte ($86), 
and San Diego ($149).^^ The smaller value of payroll tax increases offset these small gains, yielding 
results similar to those from the government budget perspective. These results are shown in Table 7.7. 

Table 7.7 also presents the final benefit-cost results from the societal perspective. Once again, 
benefits accrued to society through earnings gains, savings in transfer program administration, and 
increased output from PREP jobs. All other effects represent gains from one perspective and losses 
from the other, resulting in no effect for society as a whole. Averaging the results across all six 
counties, the net present value of the program to society as a whole (the sum of taxpayer and welfare 
sample gains) was slightly below the break-even point. As previously discussed, this assumes that a 
dollar lost by one group has the same value as a dollar gained by another group, and that GAIN caused 
no displacement effects. Also, it should be remembered that, in the future, there should be a net gain 
from the societal perspective because of continued earnings gains for experimentals. 

Although the six-county average suggests that society neither gained nor lost as a result of the 
GAIN program, results for individual counties differe\i dramatically. Riverside and San Diego posted 
net gains for both the welfare sample and taxpayers. Combining these effects yields positive net 
present values for society of $4,458 and $1,649, respectively. Butte also produced a net gain from 
the societal perspective ($1,452), although a small loss for taxpayers. At the other end of the 
spectrum, Los Angeles produced net losses from each perspective which, when combined, resulted in 
a net loss from the societal perspective of $5,046. The other two counties - Alameda and Tulare - 
achieved gains for the welfare samples but greater losses to taxpayers and the government budgets. 
These effects partially offset each other, resulting in an overall loss from the societal perspective of 
$819 in Tulare and $2,103 in Alameda. 

D. Results for AFDC-FG Registrants Determined Not to Need Basic Education 

In general, the GAIN program produced larger gains for experimentals determined not to need 
basic education than for those determined to need basic education (see Table 7.7 and Figures 7.2 and 



^^e experimental-control difference in the value of output from work experience jobs was estimated by 
multiplying the difference in average number of months in work experience by $286.33, the estimated average 
value of output per month in work experience. The second term was calculated in part from data from a 
survey for work experience participants in the San Diego SWIM program and their employers. It was assumed 
that the average GAIN experimental or control employed in a work experience job worked 59. 1 hours per 
month, received the minimum hourly wage ($4.25) plus fringe benefits of 14.8 percent, and achieved a 
productivity rate « .f 99.3 percent compared to other workers in these jobs. 
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GAIN'S BENEFIT-COST RESULTS FROM THE WELFARE SAMPLE AND GOVERNMENT BUDGET 
PERSPECTIVES FOR AFDC^FGs DETERMINED NOT TO NEED BASIC EDUCATION 
WITHIN FIVE YEARS AFTER ORIENTATION (IN 1993 DOLLARS) 



A. From the Welfare Sample Perspective 
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B. From the Government Budget Perspective 



4000 
3000 



c 

(0 Q) 
</> Q. 
O X 
UJ 



1000 
0 



Q) -1000 



o 

c 

5 J -2000 

5 > 



-3000 

c 

(1) 

(0 -4000 

a. 

^ -5000 

o 
z 

-6000 



-6041 







'""5 s. 




























-3955 







2610 



i 



•2812 



Net Loss 



-622 



Alameda Butte Los Angeles Riverside San Diego Tulare 



All Counties 



SOURCE AND NOTES: See Tables 7.1 , 7.2, and 7.7, 

-261- 



7.3). As with the full sample, all counties except Los Angeles produced positive net p esent values 
from the perspective of the welfare sample. These net gains ranged from $673 in Tulare to $5,328 
in Alameda. In four of these counties, the net present value exceeded the corresponding average for 
the full sample (and for sample members in need of basic education). For all six counties combined 
(with the results for each county weighted equally), the program averaged $2,340 in net gains for the 
welfare sample in this subgroup. 

Averaged over the six counties, the net present value from the government budget perspective 
(-$622) resembles the full sample result. However, net present values for individual counties showed 
a somewhat different pattern. The government budget realized net gains in Riverside and San Diego, 
as before ~ but also in Los Angeles. Losses were incurred in Alameda and Tulare, but also in Butte. 

E. Results for AFDC-FG Registrants Determined to Need Basic Education 

As implied by the above discussion, experimentals determined to need basic education did not 
fare as well (see Table 7.7 and Figure 7.3). Overall, this group incurred a small net loss from the 
welfare sample perspective. In four counties - Alameda, Butte, Los Angeles, and San Diego - net 
present values were negative from the standpoint of the welfare sample, ranging from -$820 in Butte 
to -$1,199 in Alameda. Interestingly, Tulare recorded the largest net present value for the welfare 
sample in need of basic education, $2,333, followed by Riverside, $1,111. As with the full sample, 
the larger gain in Tulare, compared to Riverside, was achieved with a smaller earnings gain, combined 
with a smaller reduction in transfer payments. 

Averaged across the six counties, the GAIN program produced a small net loss ($391) from the 
government budget perspective. Once again, benefit-cost results varied widely by county. Butte 
recorded a large gain ($4,816) from the government budget perspective, followed by Riverside 
($2,444); the other four counties recorded net losses, ranging from $759 in San Diego to $4,755 in 
Los Angeles. 



rV. Would a 10- Year Time Horizon Change the Overall Conclusions of the Benefit-Cost 
Analysis? 

As has been suggested several times in this chapter, the five-year time horizon may understate 
the benefits of the GAIN program. The most crucial test of this hypothesis concerns the net present 
values for Alameda, Los Angeles, and Tulare, counties that made the heaviest investment in provision 
of basic education services. Each of these counties incurred a substantial net loss from the perspective 



^^As indicated in Table 7.7, the full-sample six-county net present value from the government budget 
perspective (-S833) is lower than the corresponding average for each of the two basic education subgroups 
(-$622 and -$391). Net present values from the taxpayer perspective show the same pattern. These results, 
although seemingly odd, are in fact correct and illustrate potential effects of equal weighting of exp*.rimental- 
control differences among members of a particular subgroup, under relatively extreme circumstances: i.e., 
when (1) net present values for subgroups differ dramatically within counties; (2) subgroup sample sizes are 
very unequal within counties; and (3) the pattern of positive and negative results among subgroups varied by 
county. 



FIGURE 7.3 



GAIN'S BENEFIT-COST RESULTS FROM THE WELFARE SAMPLE AND GOVERNMENT BUDGET 
PERSPECTIVES FOR AFDC-FGs DETERMINED TO NEED BASIC EDUCATION 
WITHIN FIVE YEARS AFTER ORIENTATION (IN 1993 DOLLARS) 
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of the government budget over five years; and even in Alameda and Tulare, where the welfare sample 
did relatively well, each dollar of program expenditures produced much less than a dollar's worth of 
gains. 

A "sensitivity test" of the five-year results was performed by projecting the base period effects 
through the end of year 10, using relatively optimistic assumptions: no decoy in third-year earnings 
impacts; a 15 percent decay in AFDC impacts; and no additional program expenditures for 
experimentals or controls. 

As expected, earnings gains continued to outpace tax increases and reductions in transfer 
payments in every county except Los Angeles during years 6 through 10, Averaged over the six 
research counties, GAIN produced a net present value of about $2,700 for the welfare sample. 
Moreover, the government budget does slightly better than break even by the end of year 10. 

However, extending the follow-up does not change the pattern of results for individual counties. 
Net losses to the government budget decrease in magnitude in Alameda, Lx)s Angeles, and Tulare 
during years 6 through 10, but never approach the break-even mark. (Tulare incurs the smallest loss, 
approximately $1,500 over 10 years.) Gains to the welfare sample continue to grow in Alameda and 
Tulare. In fact, in Tulare, the 10-year results show more than a dollar's worth of net gain to the 
welfare sample for each dollar of expenditures. However, experimentals in Los Angeles continue to 
show a large net loss.^^ In short, it would require far more optimistic assumptions about the pattern 
of future earnings gains and welfare savings to alter the conclusions of this analysis in counties where 
upfront expenditures were heaviest. 



V. Summary of Results for AFDC-U Registrants 

Estimates of GAIN'S five-year effects for the AFDC-U sample used more pessimistic 
assumptions for projecting future effects than were employed for the estimates for AFDC-FGs. 
Specifically, projected earnings and related measures used an annual decay rate of 40 percent, and 
transfer payments assumed a 20 percent annual decay rate between the end of the observation period 
and the end of the five-year period after random assignment. These assumptions were based on the 
observed decline in impacts for the fiiU sample and early cohorts and on the pattern of impacts in other 
programs. 

As suggested by the impact analysis, members of the AFDC-U sample did not realize the same 
gains as AFDC-FGs, primarily because savings in AFDC and other transfers offset earnings gains to 
a greater extent. As seen in Table 7.8, the AFDC-U welfare sample incurred net losses in three 
counties (Los Angeles, Riverside, and San Diego) and net gains in two others (Butte and Tulare). 
Only in Butte did AFDC-Us receive a large net gain from the program, $2,096. Overall, AFDC-U 
experimentals incurred a small net loss of $186, compared to a net gain of $923 for AFDC-FGs. As 



It should be noted that using the above assumptions actually increases the net loss for experimentals in 
Los Angeles. That is because base period estimates of savings in transfer payments were considerably larger 
than corresponding estimates in earnings gains. This net loss is projected over five additional years when 
estimating the 10-year effects. 
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with AFDC-FGs, there was a net loss ($607) from the government budget perspective (see Table 7.9). 
GAIN produced positive net present values only in Butte ($697) and Riverside ($1,314). (See Table 
7.10.) 



VI. GAINES Effects on Non-Monetary Outcomes 

As is true of any benefit-cost analysis of welfare-to-work programs, many results could not be 
considered in the calculations of net present value, either because the effects are inherently difficult 
to quantify or because sufficient data were not available to estimate their monetary value reliably. 
This section briefly considers some impacts of GAIN discussed in Chapters 2 and 5 from a benefit-cost 
perspective, indicating whether they contribute to, detract from, or have no effect on the overall 
assessment of GAIN'S effects from the different perspectives. 

As discussed in Chapter 2, GAIN produced impacts on receipt of a GED or high school diploma 
in Alameda, San Diego, and Tulare. These impacts should be counted as a net gain for the welfare 
sample and most likely for society as well. Members of the welfare sample and their families may 
have gained additional benefits beyond whatever employment and earnings effects these education 
credentials produced, including increased self-esteem among recipients of a credential, increased 
likelihood of the sample member's serving as a role model for other adults and the children in the 
household to persevere in their studies, and perhaps greater effectiveness in helping and guiding their 
children in their schoolwork. Experimentals may also benefit from an increased possibility of future 
gains in post-secondary education or vocational training. Some of these effects may boost earnings 
gains among experimentals and their households in future years. 

In most counties, experimentals were more likely to be employed than controls, and derived 
more of their income from earnings and less from AFDC and other transfers than did controls. This 
substitution of work for welfare likely has positive value for society at large (it certainly does for the 
taxpayers and the government budget) and may be beneficial for the welfare sample and their families. 
Sample members who found employment may feel better about themselves and may feel themselves 
to be better role models for their children. Further, experimentals (particularly in Alameda) were 
somewhat more likely than controls to voice satisfaction in the quality of their jobs and their prospects 
for advancement. 

However, there are also potential negative effects of increased employment. Although not 
included in this analysis, experimentals probably incurred additional expenses for transportation, child 
care, clothing, and other work-related items, compared to controls; and these were only partially offset 
by AFDC transitional child care payments and income disregards. Experimentals, particularly single 
parents, may also have faced greater stress from trying to find good-quality child care and from other 
problems related to meeting work and parenting responsibilities. Further, as indicated in Chapter 5, 
many jobs taken by experimentals and controls did not include health benefits, although only in 
Riverside was there a measurable increase in the number of experimentals not covered by Medi-Cal 
or private health insurance. 

In general, GAIN appeared to have had no marked effect on other indicators of material or 
personal v/ell-being - number of material hardships, physical health, incidence of marriage and 
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childbirth, depression, or an assessment of sample members* lives at the time of the survey interview, 
which occurred two to three years after GAIN orientation. Of course, these results could change in 
the future with further earnings gains and welfare reductions produced by GAIN. 



VII. Conclusions 

Judgments concerning GAIN'S benefit-cost results must consider the perspective taken - in 
particular, whether it is that of the welfare sample or that of government budgets. Among the six 
counties, the performance of the GAIN program in Riverside stands out, both for the size of its net 
gains and for the consistency of gains across the different perspectives and subgroups. (However, it 
should be noted that, even in Riverside, the AFDC-U welfare sample incurred a financial loss.) 
Results were consistently negative in Los Angeles. Elsewhere, results were mixed. Among 
AFDC-FGs in Alameda and Tulare, the welfare sample experienced a net gain, but the government 
budget incurred a net loss. In San Diego, the program resulted in gains from both perspectives. In 
Butte, the welfare sample was made better off, while the government budget broke even. However, 
the results differed markedly between the basic education subgroups within these two counties. 



^^The one exception is a gain, from the government budget and taxpayers' perspectives, among AFDC- 
FGs determined not to need basic education. 
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CHAPTERS 

EXPLAINING COUNTY DIFFERENCES IN THE EFFECTIVENESS OF GAIN 



The implementation analysis discussed in Chapter 2 showed that GAIN can be operated in many 
different ways, and often must be run under quite diverse local conditions. It is therefore important 
for policymakers and program administrators, who must decide how best to spend the program's 
limited resources, to know what implications these choices and conditions hold for GAIN'S 
effectiveness. Previous MDRC reports began to explore this issue through a county-by-county 
comparison of implementation factors and first-year and second-year impacts.^ This report continues 
that inquiry using the new implementation, impact, and benefit-cost data presented in earlier chapters. 

Before embarking on the comparison of counties, it is important to consider several limitations 
of this type of analysis (which are also discussed in Chapter 1). First, because this study includes only 
six counties, and because random assignment was conducted within counties and not across counties, 
isolating the effects of any particular factor is difficult and cannot be done with the same level of rigor 
that is possible in estimating county-specific impacts. Second, the data available for this report may 
not capture many aspects of the local environment, participation, or implementation that also influence 
impacts. Third, the conclusions from this analysis could change if even longer-term follow-up were 
available. For all of these reasons, the analysis that follows must be viewed as suggestive rather than 
conclusive. 

These limitations notwithstanding, the three-year findings do bolster two important conclusions 
offered in previous reports. First, the fact that all six counties produced modest-to-large earnings gains 
or welfare savings, or both, indicates that GAIN'S effectiveness is not just a one-county story: GAIN 
can lead to increased earnings and reduced welfare payments even when operated under a variety of 
local conditions, when targeted toward different types of welfare recipients, and when implemented 
using different approaches. At the same time, the data support a second preliminary conclusion of the 
earlier reports: that the particular combination of implementation conditions and approaches identified 
in Riverside may have the largest and most consistent impacts for AFDC-FG registrants, and the most 
consistent payoff from a benefit-cost standpoint. Indeed, Riverside's three-year earnings gains and 
welfare savings, and its return to the government budget, are the largest ever found in an experimental 
evaluation of a large-scale welfare-to-work program. However, it must also be recognized that the 
Riverside program did not produce uniformly strong earnings effects in the third year, since AFDC-U 
registrants saw no statistically significant earnings gains. Also, the other counties all produced growing 
earnings impacts: The earnings gains in the third year were about as high as or higher than those in 
the second year. For specific subgroups, the third-year effects in some counties rivaled Riverside's 
in magnitude. 

Given the complexity of comparing county implementation factors and impacts, this chapter will 
focus exclusively on the results for the single-parent (AFDC-FG) sample. This choice reflects that fact 
that AFDC-FGs are the most numerous recipients in California and nationwide. 



*See Riccio and Friedlander, 1992; Friedlander, Riccio, and Freedman, 1993. 
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1. A Summary of the Counties^ Three- Year Impacts and Five- Year Benefit-Cost Results 

Figure 8.1 summarizes the county-by-county, three-year impacts on earnings and AFDC 
payments for the full AFDC-FG research sample. Figures 8.2 and 8.3 present results for registrants 
determined not to need and those determined to need basic education. Table 8.1 summarizes the main 
benefit-cost findings. These figures and the table present the county impacts and benefit-cost results 
whose links with implementation factors will be explored in this chapter. 

As the figures show, Riverside stands out among the six counties because it had large and 
statistically significant effects on earnings and welfare payments for the entire AFDC-FG sample and 
for both of the education subgroups.^ Riverside's program also had the most consistent effects for 
a variety of other subgroups, as discussed in Chapter 4. The patterns were more complex in other 
counties. Each county produced some statistically significant earnings gains or welfare savings, but 
they did not always have effects in both areas or consistently across subgroups, as Riverside did. 

Nonetheless, some of the subgroup impacts in other counties were as impressive as those found 
in Riverside. For example, among registrants determined not to need basic education, Alameda and 
San Diego had large third-year earnings impacts that were comparable to Riverside's. These results 
in Alameda are particularly noteworthy because they offer a rare example of a welfare-to-work 
program producing earnings gains for a long-term welfare population living in inner-city areas with 
a high concentration of poverty. Los Angeles also achieved a reduction in welfare payments for the 
not-in-need-of-basic-education subgroup that was comparable to Riverside's. For registrants determined 
to need basic education, Butte produced earnings impacts that were comparable to Riverside's, and 
reductions in welfare payments that exceeded those in Riverside. 

When economic benefits are compared to costs, all counties except Los Angeles made the entire 
welfare sample better off. This positive outcome was obtained more consistently for registrants 
determined not to need basic education than for the in- need subgroup, as shown in Table 8.1. In only 
two counties - Riverside and Tulare — were both education subgroups better off. 

From the perspective of the government budget, GAIN produced savings that exceeded net costs 
for the full sample in three of the six counties (Butte, Riverside, and San Diego). Only in Riverside 
did the government budget come out ahead for botli education subgroups. Moreover, it was only in 
Riverside that economic gains exceeded losses for both the welfare sample and the government, and 
for the total sample and each subgroup. 

IL The Effects of Serving Different Types of Welfare Recipients 

Chapter 1 showed that the six counties served different types of welfare recipients. For 
example, Los Angeles and Alameda served only long-term recipients, while the other counties served 
applicants and short-term recipients as well as long-term recipients. The counties also varied widely 
in the proportion of their registrants who were determined to need basic education, ranging from 49 
percent of AFDC-FGs in Butte to more than 80 percent in Los Angeles. Does this mean that the 



As mentioned in Chapter 4. the cross-county variation in GAIN'S impacts on three-year earnings and 
AFDC payments for the full sample of AFDC-FGs were found to be statistically significant. 
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FIGURE 8.1 



SUMMARY OF GAIN s THREE-YEAR IMPACTS ON EARNINGS AND AFDC PAYMENTS 

FOR AFDC FG REGISTRANTS 
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B. Impacts on AFDC Payments 
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FIGURE 8.2 



FOR AFDC^FG REGISTRANTS DETERMINED NOT TO NEED BASIC EDUCATION: 
SUMMARY OF GAIN'S THREE-YEAR IMPACTS ON EARNINGS AND AFDC PAYMENTS 
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B. Impacts on AFDC Payments 
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FIGURE 8.3 



FOR AFDC-FG REGISTRANTS DETERMINED TO NEED BASIC EDUCATION: 
SUMMARY OF GAIN*s THREE-YEAR IMPACTS ON EARNINGS AND AFDC PAYMENTS 



A. Impacts on Earnings 
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B. Impacts on AFDC Payments 



500 
0 

-500 



SJ-1000 



O -1500 

CO 

Q. 

£ -2000 



-2500 
-3000 
-3500 
-4000 



Y1: -202 
Y2: -350* 
Y3: -483* 
T: -1036* 

















V// 




Y1 


-252*** 


Y2 


: -314*** 


Y3 


: -173 




T 


: -739 





Y1: 
Y2: 
Y3: 



39 
57 
-152 




Y1: 


-677*** 


Y2: 


-700*** 


Y3: 


-509*** 




• • • 


T: 


-1886 



Y1: -281** 


T: 


-56 


Y2: -426*** 






Y3: -313** 






• • • 

T: -1020 







Alameda Butte Los Angeles Riverside San Diego Tulare 

First-Year Impacts | [ S«cond«Year Impacts 



Third-Year Impacts 



Y1: -430<a) 
Y2: -477ta) 
Y3: -42^ ta> 
T: -1329^^^ 



Ail Counties 



SOURCE: Table 4.5. 
NOTES: See Table 4.1. 

(a) Tests of statistical significance of the experimental-control difference for all counties combined 
were not performed. 
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TABLE 8.1 



SUMMARY OF THE NET GAIN OR LOSS (NET PRESENT VALUE) PER AFDC-FG EXPERIMENTAL 
WITHIN FIVE YEARS AFTER GAIN ORIENTATION. BY ACCOUNTING PERSPECTIVE 



Sample 
and County 




Accountinq Perspective 




Welfare 
Sample 


Government 
Budget 


oocieiy 


All experimentals 








Alameda 


1090 


-3054 


-2103 


Butte 


1585 


54 


1452 


Los Angeles 


-1561 


-3442 


-5046 


Riverside 


1900 


2936 


4458 


San Diego 


948 


767 


1649 


Tulare 


1577 


-2261 


-819 



Registrants determined not to 
need basic education 



Alameda 
Butte 

Los Angeles 
Riverside 
San Diego 
Tulare 



5328 
4702 
-2826 
3235 
2925 
673 



-6041 
-3955 
2892 
3576 
2610 
-2812 



-904 
621 
-11 
6328 
5235 
-2163 



Registrants determined to 
need basic education 



Alameda 
Butte 

Los Angeles 
Riverside 
San Diego 
Tulare 



-1199 
-^820 

-1162 
1111 
-968 
2333 



-2011 
4816 

-4755 
2444 
-759 

-2082 



-3299 
3656 

-5941 
3246 

-1590 
45 



SOURCE AND NOTES: See Table 7.7. 
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variation in impacts across the counties came about simply because the counties served different types 
of people? One way to address this question is to examine the county impacts within the basic 
education subgroups. Figures 8.2 and 8.3 show that, within these subgroups, there continued to be 
large cross-county variation in impacts. For example, when just registrants determined not to need 
basic education were compared, three counties (Alameda, Riverside, and San Diego) produced large 
and statistically significant earnings gains, while the other three counties did not. This suggests that 
factors other than the education needs of a countj^'s registrants must be affecting the differences in 
impacts across counties. 

Another way to assess the influence of serving different types of registrants involves re- 
estimating the earnings and welfare impacts for each county while statistically "controlling for" a host 
of demographic characteristics that varied across the counties' research samples. This kind of analysis 
(referred to as a "conditional impact analysis") is a way to estimate what the counties' impacts would 
have been if each county had served registrants who were simiiW in characteristics that are controlled 
for by the analysis. If the resulting cross-county patterns of impacts are consistent with the actual 
patterns estimated without these statistical adjustments, this would support the conclusion that county 
differences in three-year impacts were not simply a function of the types of individuals each county 
served. 

Using this method to control for a variety of demographic characteristics,^ earnings and welfare 
impacts were estimated for the full sample of AFDC-FG registrants ; Although the magnitude of some 
county impacts did change somewhat within each of these groups, the overall pattern of results 
remained nearly the same. This can be seen in top panel of Table 8.2 by comparing the "conditional" 
results, which control for registrant characteristics, with the "unconditional" results."^ For example. 
Riverside's earnings impacts remain larger than those of all other counties after controlling for 
registrant characteristics, while Los Angeles and Tulare continue to show much smaller impacts. There 
are some differences between the conditional and unconditional impacts, particularly on earnings in 
Butte and Alameda and on AFDC payments in Alameda. These differences suggest ttiat demographic 
factors accounted for some differences in county effects. However, the overall pattern of results 
supports the interpretation that factors other than the characteristics of a county's registrants explain 
the county's three-year impacts (and, especially, that the more favorable results in Riverside were not 
due to the characteristics of its registrants).^ Additional factors, including the local environment and 
the ways in which GAIN was implemented, are examined in the following sections. 



■^Impact estimates for the full sample were obtained from an impact regression in which (in addition to the 
usual control variables) the following variable sets were interacted with the experimental group dummy: county, 
educational need subgroup, past welfare receipt subgroup, prior earnings, prior AFDC payments, receipt of a 
high school diploma, ethnicity, limited English proficiency, whether the sample member had a child under the 
age of 6, and whether the sample member was a refugee. 

'^The results in the unconditional column are similar to the main impact findings discussed in Chapter 4 
and presented in Table 4.1. The minor differences in the results presented in the two tables come from the 
fact that the analysis pooled all of the counties' research samples together when estimating the county-specific 
impacts presented in Table 8.2, whereas for Table 4.1 it kept the county samples separate. 

^A few caveats should be kept in mind. For one thing, controlling for still other demographic factors 
(achievement test scores in particular) might have caused more substantial changes in impacts, a possibility that 
has not yet been explored. Furthermore, it may be impossible even with this technique to know the influence 
of some wimeasured differences in the characteristics of each county's enrollees. 
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TABLE 8.2 



SUMMARY OF GAIN'S THREE-YEAR IMPACTS ON EARNINGS AND AFDC PAYMENTS 
FOR AFDC-FG REGISTRANTS, BY COUNTY AND GAIN OFFICE 



County and Office 



Average Total Earnings Impact, 

Years 1 -3 ($) 

Sample Size Unconditional Conditional 



Average Total AFDC Impact, 

Years 1 -3 ($) 

Unconditional Conditional 



County-level analysis 



Alameda 
Butte 

Los Angeles 
Riverside 
San Diego 
Tulare 



1205 
1229 
4396 
5508 
8219 
2234 



1588 ** 
1693 * 

303 
3142 *** 
1740 *** 

527 



1265 (b) 
887 (b) 
558 (b) 
4184 (b) 
1524 (b) 
575 (b) 



-762 

-951 

-976 *** 
-2004 *** 
-1234 *** 
217 



0 (b) 
-952 (b) 
-803 (b) 
-2699 (b) 
-1217 (b) 
-39 (b) 



Office- leyel analysis 

Alameda 

Butte 



1205 
1229 



1589 ** 
1692 * 



1022 (b) 
792 (b) 



-763 
-942 



177 (b) 
-879 (b) 



Los Angeles 
San Fernando Valley (Region 2) 
San Gabriel Valley (Region 3) 
Central (Region 4) 
Southern (Region 5) (a) 
Southeastem (Region 6) 

Riverside 
Riverside 
Hemet 

Ranoho Mirage 
Elsinore 



635 
432 
1130 
1559 
640 



2530 
1450 
960 
568 



2129 * 
2276 
20 
-272 
-1081 



2882 *** 
3323 *** 
2545 ** 
4886 *** 



1953 (b) 
2415 (b) 
-140 (b) 
-432 (b) 
-820 (b) 



4387 (b) 
4496 (b) 
3187 (b) 
6281 (b) 



-1906 *** 

127 
-581 

-1522 *** 
-134 



-2152 *** 
-1240 ** 
-2268 *** 
-2785 *** 



-1620 (b) 
357 (b) 
37 (b) 
-858 (b) 
-186 (b) 



-3267 (b) 
-1889 (b) 
-2459 (b) 
-3462 (b) 



San Diego 
Metro GAIN 
Southeast 
Escondido 
Oceanside 
Northeast 
South Bay 
El Cajon 
Metro Refugee 



571 
1228 
873 
536 

1439 
1800 
1409 
363 



2051 
1285 
3048 ** 
2086 
2744 *** 
1232 
1012 
525 



1206 (b) 
1325 (b) 
2193 (b) 
1391 (b) 
2409 (b) 
1171 (b) 
249 (b) 
1192 (b) 



-1855 * 

-849 

-852 
-1794 * 

-616 
-1197 ** 
-1530 ** 
-3419 *** 



-1737 (b) 
-505 (b) 
-902 (b) 
-1666 (b) 
-337 (b) 
-1273 (b) 
-1509 (b) 
-3251 (b) 



Tulare 
Dinuba 
Lindsay 
Portervllle 
Tulare 
Visalia 



307 
338 
567 
503 

519 



-303 
685 
1702 
-222 
240 



-148 (b) 
556 (b) 
1573 (b) 
-334 (b) 
148 (b) 



431 
568 
■1247 * 

524 
1102 



70 (b) 
357 (b) 
•1374 (b) 
311 (b) 
965 (b) 



SOURCE: See Table 4.1. 

NOTES: (a) This region serves the low-Income communities of Watts. Compton, and North Long Beach, 
(b) A test of statistical significance was not performed. 
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ni. The Influence of the Local Environment 



The expected influence of the local environment, particularly the labor market, on a welfare-to- 
work program's impacts is not clear. ^ A program operating in a strong labor market may have an 
easier time placing welfare recipients into jobs, but it is also possible that recipients may do just as 
well on their own (as reflected in the experiences of a control group) if jobs are plentiful, so that the 
net effect of the program will be low. Alternatively, a weak labor market might hinder the efforts of 
welfare recipients to find work (or better-paying or longer-lasting jobs) regardless of whether or not 
they are in a welfare-to-work program. Or a weak labor market may make the help provided by a 
welfare-to-work program more valuable, since it might be more difficult for registrants to locate and 
qualify for hard-to-fmd job openings on their own7 This report explores these hypotheses using 
several measures of the local labor market in each county. 

A. Unemployment Rate 

The top panel of Table 8,3 presents unemployment rates for the six counties dvring much of 
the follow-up period for this study. It shows that the average unemployment rate during the period 
of random assignment and follow-up varied from under 6 percent in Alameda^ and San Diego to 14 
percent in Tulare, (See Table 1. 1 for the year-by-year unemployment rates. )^ However, this varietion 
is not consistently related to the county impacts presented in the previous figures. As one illustration, 
Butte's average annual unemployment rate (9.2 percent) was about 4 percentage points higher than 
Alameda's (5.3 percent), yet both counties had nearly identical three-year impacts on earnings (Figure 
8,1A), In general, a county's unemployment rate does not seem to have determined whether its 
impacts were larger or smaller. 

B. Growth in the Number of Employed Residents 

An alternative measure of a county's labor market is the average annual rate of growth in the 
number of residents who are employed. An increase in this indicator may signal an expam-ion of 
opportunities to find work. Table 8.3 presents this information for each county for the period between 
July of the calendar year in which random assignment began in a county and July 1992. Riverside had 
the highest average annual growth rate, at 4.9 percent per year during the research period. However, 



^The influence of the labor market on impacts may be complex because the labor market influences not 
only the opportunities for experimentals and controls to find work, but also the types of individuals — in terms 
of their motivation to work, job skills, education levels, and employment barriers - who come onto welfare 
and into the program in the first place. 

^In fact, a number of studies of earlier welfare-to-work programs have found greater impacts for enrollees 
who entered the programs during periods of economic downturns compared to those who entered under more 
favorable economic conditions, at least in urban areas. Overall, however, the evidence on the influence of the 
local economy on a program's impacts is quite limited. See Gueron and Pauly, 1991, p. 186. 

^The unemployment rate in Oakland, where Alameda's GAIN office was located, appears to have been 
higher than in other parts of the county. 

^Table 1.1 shows that in the last 12 months in which follow-up data were collected (July 1992 to June 
1993), unemployment rates were lowest in Alameda (6.6 percent) and Saii Diego (7.7 percent). The rate 
exceeded 10 percent in Butte (1 1.9 percent), Los Angeles (10.1 percent). Riverside (12.8 percent), and Tulare 
(15,4 percent), 
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as the table shows, growth rates were highest in that county early in the study period and, in one of 
the four years covered, growth rates were slightly negative. Tulare had the next highest growth rate 
(23 percent). Growth rates were noticeably lower in the other four counties: 1.5 percent in Butte, 
1.1 percent in San Diego, .8 percent in Los Angeles, and -1.1 percent in Alameda. 

Employment growth rates may have a greater effect on GAIN'S impacts than does a county's 
unemployment rate. For example, it is possible that Riverside's higher average growth rate may have 
contributed to its impacts. At the same time. Riverside's impacts were consistently large during each 
year of the follow-up period, even though its economic growth rate varied over time. Furthermore, 
as the bottom panel of Table 8.2 shows. Riverside's three-year earnings impacts were large and 
positive in each of the four localities (represented by different offices) included in the evaluation, 
despite the fact that economic conditions varied markedly among these areas. These findings cast 
doubt on Riverside's growth rate as an explanation for the impact of its GAIN program. 

Comparisons across the other counties also suggest that GAIN'S effectiveness is not determined 
by local economic conditions. For example. Figure 8.2A shows that, for AFDC-FGs determined not 
to need basic education, both Alameda and San Diego had impacts on earnings, despite Alameda's 
negative growth rate and San Diego's low growth rate. In addition, despite Butte and San Diego having 
had fairly similar patterns of economic growth, Butte produced large impacts on registrants determined 
to need basic education and San Diego did not.^^ 

Control Group Earnings 

The control group's earnings are also a useful gauge of botli local economic conditions and the 
propensity of sample members to earn income in the absence of GAIN. These earnings were 
determined by the opportunities to find work in the local labor mar^.cet; by the quality of jobs available;' 
by the motivation, skills, and barriers to employment of individuals lov)king for work (either in their 
own county or in another locality); and by other individual and kx:al labor market factors. Because 
members of the control group did not have access to GAIN services and were not subject to its 
mandate, their average earnings represent what the experimental would have earned without the 
program's influence. Thus, a finding that the control group's earnings were strongly related to GAIN'S 
impacts across the counties would support the hypothesis that the county variation in impacts was 
shaped by county differences in the types of people they served, their local economies, or a 
combination of these two factors. 

The evidence shows that the variation in three-year earnings impacts was not strongly and 
consistently related to the level of the control groups' earnings. Figure 8.4 presents average earnings 
in follow-up year 3 in each county for the full sample of AFDC-FGs, and for the two basic education 



^^For example, the Hemet and Elsinore offices are located in more rural areas of the county, while the 
Riverside office is located in a more urban and suburban area. 

"it should be noted that some of these interpretations differ from those discussed in the report on GAIN'S 
two-year impacts (Friedlander, Riccio, and Freedman, 1993), which considered the possibility that Tulare's 
consistent absence of impacts may have been due to the poor state of the economy in that county, and that the 
economy might have had a more important influence on AFDC-FGs determined to need basic education. The 
longer-term impact data and updated information on county employment growth rates appear to weaken those 
interpretations. 
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subgroups. The experimental group's earnings are represented by the shaded bars; the control group's 
earnings by lined bars. A county's impact is indicated by the difference between the lengths of the two 
bars. As Figure 8.4B illustrates for those determined not to need basic education, the control group's 
earnings in Alameda and Los Angeles were nearly identical. But the experimentals' earnings, and 
hence the counties' impacts, differed substantially. Figure 8.4C shows that, for AFDC-FGs 
determined to need basic education, five of the six counties (San Diego was the exception) had control 
groups with comparable earnings but that these counties produced widely different impacts. Figure 8.4 
reveals no overall pattern of counties with larger impacts also having had control groups with higher 
average earnings. These findings further support the proposition that three-year impacts were not 
solely a function of the types of individuals counties served or local economic conditions — at least 
as far as these could be measured for this study. 

This is not to say, however, that local conditions or the characteristics of a county's registrants 
do not matter at all. It is possible that characteristics not measured by this study do play a role. For 
example. Table 8.2 shows the three-year earnings impacts across GAIN offices serving different 
regions of Los Angeles County. Two offices — the San Fernando Valley and San Gabriel Valley 
offices, both of which served communities outside the central city — produced impacts exceeding 
$2,000, while the other three offices (including the large Southern office that served Watts and other 
low-income communities) appear to have had no effect or a negative effect. This study cannot rule 
out with certainty the possibility that unmeasured variation in registrants' demographic characteristics, 
attitudes, or personal situations, or in the characteristics of their local communities, might have 
contributed to this type of variation. 



rV. The Relationsliip Between County Participation Patterns and County Impacts 

If county differences in the types of people they served and the characteristics of their local 
environment - at least as far as these dimensions could be measured for this report - do not 
satisfactorily explain the county variation in three-year impacts, it is important to ask whether 
differences in the GAIN treatment across the counties may have affected these impacts. 

Table 8.4 examines experimental-control differences in the use of employment-related services 
over a two- to three-year follow-up period. The following discussion will focus on the results for 
each basic education subgroup, since these subgroups represent different types of people who, in 
keeping witli the GAIN model, were directed toward different service paths in the GAIN program. In 
addition, the discussion considers the role of registrants' participation in only three types of activities 
- job search, basic edr tion, and vocational training and post-secondary education - since these 
were the most commo'" ised activities. 

A. Results for Registrants Determined Not to Need Basic Education 

1. The influence of participation in |ob search . Among AFDC-FGs who were 
determined not to need basic education, the cross-county comparisons do not point to a strong, 
consistent relationship between a county's impact on the percentage of registrants who participated in 
job search within two to three years after random assignment and the county's three-year earnings 
impact. For example, the second panel of Table 8.4 shows that Alameda increased experimentals' rate 
of participation in job search (i.e., compared to the control group rate) by 52 percentage points, while 
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San Diego's impact, at 34 percentage points, was noticeably smaller. Yet, the two counties had 
virtually the same three-year earnings impacts for the not-in-need subgroup ($2,947 and $3,040, 
respectively). Moreover, Tulare had an impact on the rate of participation in job search that was 
nearly as high as Riverside's, yet its three-year earnings impacts were actually negative for this 
subgroup (although not statistically significant), while Riverside's were the largest of the six 
counties. 

The simple fact of participation in job search may not be not enough, by itself, to produce 
impacts on earnings, as the Tulare example suggests. Perhaps the "message" about employment that 
program staff communicate in job search classes and at other times is also important. 

As discussed in Chapter 2, Riverside's strong emphasis on "quick job entry" - reinforced by 
job placement standards for case managers and a strong job development component — was an 
important feature that distinguished its program from other counties' programs, (For a summary of 
the counties' rankings on this and other implementation dimensions, see Table 8.3.) Data from the 
registrant survey offer some corroboration of this portrait of Riverside's approach. When respondents 
were asked, "How much did the GAIN staff push you to get a job quickly, even before you felt 
ready," 47 percent of those in the not-in-need subgroup in Riverside who answered this question 
answered "high" (7 to 10 on a 10-point scale). Over 36 percent of respondents in the not-in-need 
subgroup in San Diego also answered "high," while the percentages were much lower in the other 
counties. In Tulare, only 15 percent of respondents in this subgroup indicated they felt "pushed" to 
take a job quickly; this might be a reason why, despite its large impact on the rate of participation in 
job search, Tulare did not produce a positive effect on earnings. 

An understanding of the employment "message" that Alameda communicated to registrants also 
raises questions about the contribution that county's large impact on the rate of participation in job 
search made to its sizable earnings impact for AFDC-FGs determined not to need basic education. 
Chapter 2 explained that Alameda's participants in job clubs were not routinely expected to use that 
activity to find a job that they would take immediately, but, instead, to use it as an "informational 
experience" for learning about the kinds of jobs that were available, the kinds of credentials employers 



*^The participation daia available for Butte (where the registrant survey was not conducted because of a 
limited survey budget) were not suitable for computing impacts on the rate of participation in a given 
component within the two- to three-year period. However, it is possible to produce reasonable approximations 
of these rates for job search and basic education activities if the following assumptions can be made: that the 
experimental group's two- to three-year rates of participation in job search and basic education were not likely 
to be much higher than the rates determined from the 1 1 -month casefile tracking data discussed in Chapter 2 
(as appears to have been the case in the other counties); that experimentals in Butte, as in the other counties, 
seldom participated in these two types of activities after leaving the GAIN program; and that the control group 
in Butte had rates of participation in job search and basic education as low as the rates among controls in the 
other counties. For registrants determined not to need basic education, the experimental group's rate of 
participation in job search in Butte was about 33 percent, based on the casefile data. The control group's two- 
to three-year rate of participation in job search across the other five counties was estimated to be about 4 
percent. Thus, if the above assumptions are true, which seem reasonable, Butte's impact on the rate of job 
search participation would be about 29 percentage points. If this estimate were off by up to 25 percei.t in 
either direction (an extreme assumption), Butte's impact would fall in the range of 22 to 36 percentage points. 
Thus, it seems likely that Butte's actual impact was closer to Los Angeles's and San Diego's than to the other 
counties' impacts on this measure. 
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required, the wages that would be paid, and so on, and to use this information in selecting a vocational 
training or post-secondary education activity. This may be why in Alameda only 16 percent of 
respondents in the not- in-need-of-basic-education subgroup indicated on the above survey question that 
GAIN staff had "pushed" them to take a job quickly. This is not to say, of course, that some 
participants did not use job search as a route to immediate employment, only that they may not have 
been under the same degree of pressure to do so as in Riverside and San Diego. While it is impossible 
in this study to determine the relative importance of any single component, Alameda's approach to job 
search suggests that its earnings impacts may have resulted as much or more from other factors, such 
as its impact on the use of vocationally oriented education and training, which is discussed next. 

2. The influence of participation in vocational training or post-secondarv education , 

GAIN registrants could take part in a number of education and training activities. As discussed in 
Chapter 2, these included self-initiated education and training and post-assessment activities, which 
were typically vocationally oriented courses at community colleges, adult schools, and other training 
centers and schools. Moreover, according to data from the registrant survey, many registrants took 
part in similar types of activities on their own after they were no longer in the GAIN program. 

These activities comprised almost all of the education and training for experimentals determined 
not to need basic education, who used them widely. Across five counties (i.e., not including Butte, 
where the participation rate was not determined), 43 percent of all experimentals in this subgroup were 
estimated to have participated in such activities within two to three years after orientation, (See 
Chapter 2, Table 2.7.) At the same time, controls in most counties were almost as likely as 
experimentals to have done so (36 percent across the five counties), even without the assistance of the 
GAIN program. Alameda and Tulare had the largest impact on the rate of participation in those 
activities (16 and 12 percentage points, respectively), and Alameda produced the largest increase of 
all five counties (3 months) in the average number of months of participation in the activity per 
experimental (Table 8.4). In addition, Alameda produced a small increase (6 percentage points, 
although this was not statistically significant) on the proportion of registrants in this subgroup i T<eiving 
a trade certificate during the follow-up period, and a small but statistically significant increase (3 
percentage points) on receipt of a Bachelor's degree. (See Chapter 2, Table 2.9.) (San Diego was the 
only other county to produce a statistically significant increase on the receipt of a credential for the 
not-in-need-of-basic-education subgroup - a 5 percentage point increase in the proportion receiving 
an Associate's degree.) 

Alameda's impact on the use of vocational training or post-secondary education may thus help 
to explain its overall positive earnings gains for the not-in-need subgroup. In contrast. Riverside 
produced no net increase in the percentage of experimentals in this subgroup who participated in 
vocational training or post-secondary education; if anything, it seems to have slightly reduced the use 
of those services by experimentals. The comparison of Alameda with Riverside thus suggests that 
these two counties may have achieved impacts on earnings gains for the subgroup in different ways.^^ 
Yet, because Alameda's earnings gains were not accompanied by welfare savings, as was the case in 
Riverside, and because of the net expense of the Alameda experimental group's extra months of 



It is interesting to note that the impacts Riverside and San Diego had on earnings for the early cohorts 
of the not-in-need subgroup were sustained in the fourth year of follow-up. (See Chapter 4.) Alameda's early 
cohort does not have a full fourth year of follow-up to permit an accurate comparison to be made with the 
longer-term effects in Riverside and San Diego. 
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participation in education and training, the Alameda strategy was a costlier one from the perspective 
of government budgets, as reflected in the benefit-cost findings presented in Table 8.1. 

B. Results for Registrants Determined to Need Basic Education 

1. The influence of participation in fob search . Two of the six counties - Butte and 
Riverside ~ had large and statistically significant three-year earnings effects for AFDC-FG registrants 
determined to need basic education. Table 8.4 shows that, of all the counties. Riverside had the 
largest impact on experimentals' rate of participation in job search activities, increasing that rate by 
31 percentage points above the control group rate. While it is possible that this effect contributed to 
Riverside's earnings impact for the in-need subgroup, the findings in the other counties do not indicate 
a consistent association between a county's effects on the use of job search and its earnings impacts. 
For example, although Butte's impact on the rate of participation in job search has not been determined 
(owing to limitations of the data available for that county), a reasonable estimate places it at a much 
lower level than Riverside's.^"^ Moreover, Tulare, which produced a statistically significant earnings 
impact on this subgroup of $690 in the third year of follow-up, had an impact of only 12 percentage 
points on the rate of participation in job search, which is lower than the 20 percent impact in San 
Diego, which did not produce a statistically significant earnings effect. 

This pattern of findings across the counties suggests that factors other than, or in addition to, 
a county's impact on job search may determine its earnings effects. Another consideration in this 
regard is that, judging from the findings of past research on welfare-to-work programs, the 
magnitude of Riverside's impacts on earnings for the in-need subgroup seem too large to have been 
solely the product of its effects on the use of job search. 

2, The influence of participation in basic education . Across all six counties, a 
somewhat higher or substantially higher proportion of AFDC-FGs in need of basic education took part 
in ABE/GED activities than in job search or in vocational training or post-secondary education, (A 
smaller proportion participated in ESL classes.) Interestingly, the county comparisons suggest that 
large impacts on the rate of participation in basic education activities, or on the per-experimental 
average number of months participating in those activities, do not correspond to large three-year 
earnings impacts (see Figure 8.3 and Table 8,4). For example, while Riverside had effects on the rate 
of participation in ABE/GED classes (24 percentage points) and on the average number of months 
participating in them (1 . 1 months per experimental) comparable to the effects on those measures in San 
Diego, it produced much larger earnings gains. Moreover, Alameda, which had the largest impact 
on the use of ABE/GED (increasing tlie rate of participation by 52 percentage points and the number 



Following the same kinds of assumptions discussed in footnote 12, a rough approximation of Butte's two- 
to three-year impact on job search for the in-need subgroup can be made. The 1 1 -month participation rate for 
experimentals, based on Butte's GAIN tracking data, was about 6 percent. The average rate of the controls' 
participation in job search in the other five counties was only about 3 percent. If these two rates accounted 
for all of the participation among experimentals and controls, respectively, in Butte's in-need-of-basic-education 
subgroup, Butte's impact on job search would be 3 percentage points. If this estimate were off in either 
direction by 25 percent the impact would fall within the range of 2 percentage points to almost 4 percentage 
points. Although the actual impact is not known, it seems unlikely that it would approach Riverside's 31 
percentage point impact, 

'^See Gueron and Pauly, 1991, 
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of months participating by 4.4 months per experimental), had a relatively small impact on earnings for 
this subgroup. 

The positive results for Butte and Riverside are particularly striking because these two counties 
adopted such different strategies for implementing GAIN. Furthermore, it seems unlikely that their 
positive effects came from exposing basic education participants to education activities or schools of 
exceptional quality. Although quality is very difficult to judge, it is notable that responses to a relevant 
staff survey question, which asked case managers "how worthwhile" they believed the basic education 
services in their county to be for the registrants assigned to them, suggest just the opposite. As shown 
in Table 83, only 36 percent and 48 percent of the staff in Butte and Riverside, respectively, gave 
a high rating to basic education, compared to 57 percent to 79 percent in the other four counties, 
(Ratings of basic education were especially high in San Diego and Tulare, 

The influence of participation in basic education on the earnings impacts that these two counties 
produced for the registrants determined to need basic education thus remains open to question. The 
issue is especially perplexing in Riverside, where evidence from MDRC's special report on GAIN 
basic education detected no evidence that, on average, the program increased the reading or math 
ability of sample members in this subgroup, as measured by a literacy test administered as part of the 
registrant survey. Furthermore, it appears that the Riverside program did not increase the 
likelihood that experimental (compared to controls) would obtain a GED or high school diploma 
during the survey follow-up period (see Chapter 2, Table 2.9),^^ At the same time, as previously 
mentioned, the magnitude of Riverside's impacts on earnings for this subgroup seem too large to have 
been the product simply of its impacts on job search participation rates, 

A number of hypotheses can be offered, although none of them can be tested with the data 
available for this study. One possibility, of course, is that the literacy test used to assess sample 
members' basic skills did not measure other kinds of learning produced by GAIN's basic education 
activities that may have helped prepare registrants to look for, compete for, and perform work. Or 
it may be that participation in GAIN basic education in Riverside influenced the labor market behavior 
and opportunities of participants in ways that had little to do with improving their basic literacy skills. 
For example, perhaps it strengthened their self-confidence and expectations of success in the labor 



^^Following the same kinds of assumptions discussed in footnote 12, a rough approximation of Butte's two- 
to three-year impact on the rate of participation in ABE/GED for the in-need subgroup can be made. The 11- 
month participation rate for experimentals, based on Butte's GAIN tracking data, was about 21 percent (see 
Martinson and Friedlander, 1994, Table 3,2). The average rate of the controls' participation in ABE/GED in 
the other five counties was only about 7 percent. If these two rates accounted for all of the participation 
among experimentals and controls, respectively, in Butte's in-need-of-basic-education subgroup, Butte's impact 
on ABE/GED would be 14 percentage points, if this estimate were off in either direction by 25 percent, the 
impact would fall within the range of 1 1 percentage points to almost 1 8 percentage points. Although the actual 
impact is not known, it seems unlikely that it would exceed Riverside's 24 percentage point impact. 

^''In San Diego, the results reflect the very high regard case managers had for the GAIN Learning Centers, 
which provided individualized and computer-aided instruction, for GAIN students. The schools in Tulare also 
provided a great deal of individualized instruction, in some cases making extraordinary efforts to cultivate a 
supportive environment for learning in classrooms devoted exclusively to GAIN students. 

^^See Martinson and Friedlander, 1994. 

'^Information on skills gains and educational attainment was not available in Butte because MDRC's GAIN 
registrant survey was not fielded in that county. 
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market, and perhaps those changes in attitudes emboldened them to look for work more seriously or 
diligently than they would have in the absence of GAIN. This type of attitudinal change might have 
been enhanced in Riverside if, while participating in education activities, registrants continued to be 
subjected to Riverside's strong employment message through their ongoing contacts witli GAIN case 
managers. (In this regard, it is interesting to note that about 40 percent of Riverside's respondents in 
the in-need-of-basic-education subgroup gave a "high" response to the question, discussed above, about 
how much GAIN staff "pushed" them to take a job quickly - a higher percentage than in the other 
counties.) Participants' motivation to work might also have been enhanced through interactions with 
teachers and peers at their schools. Also, as GAIN participants, experimentals taking part in basic 
education activities continued to have access to the GAIN staffs direct assistance with job 
development, which may have increased their success in locating job openings. 

A different type of hypothesis is suggested by the finding, discussed in previous MDRC reports, 
that Riverside's registrants who were determined to need basic education and who participated in a 
GAIN activity were more likely than those in other counties to have participated in job search as their 
initial assignment. Perhaps this strategy allowed the program to divert from basic education 
individuals who were able to find employment without that intervention.^^ A similar "sorting" effect 
might also have occurred in Butte, though for an entirely different reason. As mentioned in Chapter 
2, Butte created a waiting list for assignment to GAIN activities as a way of keeping registrant-to-staff 
caseloads low. One consequence of this waiting list was that some people who were capable of finding 
jobs on their own, but who might have been assigned to basic education, entered the labor market 
during this waiting period and avoided the opportunity cost (and, perhaps for them, the uncertain 
payoff) of participating in a basic education assignment. 

Another consideration (which could apply more broadly across tae counties and across 
subgroups) is that Butte's and Riverside's earnings impacts for the in-need subgroup might have come 
about in part because their programs may have affected the behavior of nonparticipants as well as 
participants. For example, GAIN'S participation obligation may have encouraged some individuals to 
seek a part-time or full-time job, or simply to leave welfare, in order to avoid going to school or to 
another GAIN activity. A "deterrence effect" of this type, if it existed, might also have affected the 
behavior of some participants who, after having participated in the activity for a short time, may liave 
decided that working (and/or leaving welfare) was preferable to going back to school as an adult. 



V. The Influence of Responding to Noncompliance Through Formal Enforcement 

Chapter 2 showed that the counties varied in their use of GAIN'S formal mechanisms for 
enforcing the program's participation mandate. This process begins when a registrant who has failed 
to attend an assigned activity without good cause is placed in a "conciliation process" involving case 
managers and supervisors, and it ends, if compliance with the participation mandate is not achieved, 
with the imposition of a financial penalty in the form of a sanction (i.e., a reduction in the welfare 



2^See Freedman and Riccio, 1991; Martinson and Friedlander, 1994. 

^Mn San Diego, according to program staff, participation rates in basic education as an initial activity grew 
over time as more slots opened up in the county's Learning Centers. However, the program's impacts were 
larger for the early cohort of sample members determined to need basic education than for the later cohort. 
See Friedlander et al., 1993, pp. 123-24, for further discussion of this issue. 
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grant), Los Angeles and Riverside relied more heavily on this process, invoking it for about one-third 
of all AFDC-FG registrants within the initial 11-month follow-up period (according to casefile data), 
although only about 6 percent had actually been sanctioned during that time, (Registrant survey data, 
which were self-reported, suggest that actual sanctioning rates climbed in all the counties over time,) 

When these patterns are compared to the cross-county differences in three-year impacts, they 
indicate no consistent relationship between formal enforcement and earnings effects. There is also no 
consistent evidence that greater reliance on formal enforcement was strongly associated with greater 
welfare reductions across the counties. For example, Butte, Los Angeles, and San Diego produced 
similar reductions over three years, despite differences in their use of formal enforcement. 

Any effect that enforcement may have had on welfare savings in any of the counties may have 
been due, in part, to the simple fact that sanctions - to the extent that they were used - directly 
reduced the welfare grant. How much of these savings may have come directly from people who were 
sanctioned is difficult to determine, however. As suggested above in the discussion of deterrence 
effects, at least some of the savings may have come from recipients who were not actually sanctioned, 
but whose decisions about leaving welfare were influenced by the requirement to participate in an 
activity, backed up by the threat of sanctions. For example, a strong emphasis on enforcement may 
send a "tougher" message to registrants about GAIN'S participation obligation, which may influence 
individuals who are never sanctioned. It might even encourage some registrants to leave welfare — 
and hence GAIN - without ever taking part in a program activity, and possibly without ever being 
sanctioned. It may be that formal enforcement can work through a variety of channels to influence 
welfare savings, although the exact processes have not been investigated for this report. 

VI. The Influence of Alternative Combinations of Implementation Strategies and Conditions 
on GAINES Three- Year Impacts 

A. An Overall Assessment 

As discussed at various places in this report, the counties' implementation approaches differed 
substantially from one another. This is not surprising, given California's state-supervised but county- 
operated welfare system. Yet, despite these, differences, all six counties produced at least some 
positive - and growing - impacts over the three-year follow-up period. In particular, a number of 
counties produced statistically significant earnings gains in combination with welfare reductions, even 
though they made very different choices regarding how much to emphasize quick job entry, formal 
enforcement, personalized attention, and regarding other program dimensions such as the types of staff 
they hired to serve as case managers, •^'^ The positive results obtained despite the fact that die 
programs were operated under different economic conditions and registered welfare recipients who, 
as a group, had quite different demographic profiles and patterns of participation in GAIN activities. 
For example, Butte, like Riverside, produced statistically significant earnings increases for registrants 
who were considered in need of basic education. Yet Butte, in contrast to Riverside, achieved its 
results while placing a much lower emphasis on quick job entry, a higher emphasis on personalized 
attention, and a much lower emphasis on formal enforcement, Alameda, Riverside, and San Diego 



^^See Table 8.3 for data on county variations on several measures of staff background characteristics and 
other implementation factors. 
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all had statistically significant earnings increases for AFDC-FG registrants determined not to need 
basic education, in the face of other combinations of rankings on these dimensions. These findings 
support the general conclusion that a variety of approaches to implementing GAIN can produce impacts 
on earnings and welfare payments. This is a promising result because variations in implementation are 
always likely to occur and because differences in local environments are an inescapable fact of life. 
At the same time, however, while five of the six counties produced positive benefit-cost results from 
the welfare sample perspective, only three of the six produced a return to government budgets equal 
to or exceeding the net public investment per experimental, 

B. The Case of Riverside 

While evidence of GAIN'S effectiveness was found in all six study counties. Riverside continues 
to stand out by virtue of the overall magnitude and consistency of its impacts, as it did in MDRC's 
1993 analysis of GAIN'S two-year impacts. It produced both earnings gains and welfare savings 
across a wider variety of AFDC-FG subgroups than any other county, demonstrating that it could 
achieve effects on each of these important measures for a broad segment of the GAIN caseload. 
Moreover, Riverside was the only county of the six where the benefit-cost findings were positive from 
the perspectives of both the welfare sample and the government budget, and for registrants in each of 
the basic education subgroups. For all of tliese reasons, it is important to ask what was distinctive 
about Riverside that might explain its comparatively robust pattern of impacts. Although this study 
cannot prove the causality of any single program feature or set of factors, a number of interpretations 
are worth considering. 

As previously discussed, one of Riverside's most distinctive features was its unusually strong 
employment "message," which emphasized to registrants the importance of getting into jobs quickly. 
Perhaps this pervasive message - backed up by the county's strong job development efforts and its 
use of job placement standards for case managers, in combination with a strong commitment to 
enforcing the participation mandate - affected how much effort registrants (across a number of 
subgroups) made to look for a job, and how willing they were to accept a job with relatively low pay. 
This does not mean that Riverside was "just a job search program"; quite the contrary. Although it 
had a relatively high job search participation rate (e.g., 34 percent among all AFDC-FG experimentals 
according to the 11-month casefile data), it had an equally high rate of participation in education and 
training activities. As shown in Table 2.1, 36 percent of Riverside's AFDC-FG experimentals 
participated in some type of GAIN-related education or training (most of which was basic education 
and self-initiated post-secondary education, or occupational training) within the first 1 1 months after 
orientation. These participants (some of whom also took part in job search activities) represented a 
majority — 60 percent ~ of those experimentals who entered any GAIN activity in Riverside during 
that initial period. At the same time, most of the estimated longer-term experimental-control 
difference in service use in Riverside was limited to job search for the AFDC-FG registrants 



^^Although Riverside's welfare savings for AFDC-Us remained substantial for the three-year period, the 
decline in the county^s earnings impacts on AFDC-Us is an important reminder that even a broadly effective 
GAIN program may not be successful in improving the earnings of all important segments of the welfare 
caseload. 

^'^As also shown in Table 2.1, 57 percent of GAIN participants in Riverside took part in job search within 
the first 1 1 months, either as their sole GAIN activity or as one of their GAIN activities. 
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determined not to need basic education, and to job search and basic education participation for those 
who were determined to need this service. 

Along many other dimensions that (theoretically) might be related to a program's effectiveness, 
Riverside was not unique. For example, while its overall GAIN participation rate (counting all GAIN 
activities) among AFDC~FGs was high (60 percent during the first 1 1 months of follow-up according 
to the casefile data), it was no higher than in Alameda and Tulare. And while Riverside ranked 
relatively high in the quickness with which it resorted to the formal penalty mechanisms to enforce 
GAIN'S participation mandate, so did Los Angeles. Thus, each of these factors, alone, does not 
explain Riverside's performance. 

It also seems unlikely that Riverside's results can be attributed simply to the availability or 
quality of its services, if staff perceptions of these services are any guide. Riverside does not stand 
out from the other counties as having had the most (or least) favorable ranking on these dimensions 
(see Table 8.3). Riverside also does not stand out as having a more highly educated staff, although, 
along with San Diego, a higher proportion of Riverside's staff had previously worked in an education 
or training program, such as a Work Incentive (WIN) or JTPA program, which may have helped 
prepare them to operate GAIN. Furthermore, Riverside did not have the highest or most favorable 
ranking (compared to the other counties) in terms of its line staffs job satisfaction and morale, 
perceptions of welfare recipients' desire to work, and belief in GAIN'S ability to help registrants, or 
in its registrant-to-case-manager ratio (see Table 8.3 and Figure 2.3). 

What most distinguished Riverside from the other counties - and, therefore, what might have 
contributed to Riverside's more favorable results - was its particular combination of practices and 
conditions, for Riverside followed a constellation of practices not found in any other county: the 
pervasiveness of its employment message and job development efforts, a strong commitment to 
securing the participation of all mandatory registrants (and having adequate resources to meet this 
objective), quicker reliance on GAIN'S formal enforcement mechanisms, and an effort to limit the 
involvement of registrants' participation in GAIN-related activities to primarily to job search and basic 
education for the subgroup needing basic education (with strong encouragement to enter job search 
first) and, as much as possible, to job search alone for registrants detennined not to need basic 
education (participation patterns that helped to contain GAIN costs). Riverside's approach may have 
enjoyed an "added boost" from its growing economy early on, but, as previously discussed, there are 
reasons to believe that this was not the determining factor. 

The Riverside results also suggest that the high levels of personalized attention found in several 
of the other counties may not be essential for producing large impacts, since Riverside ranked lower 
by comparison on this dimension than all other counties except Lx)s Angeles. 

Finally, it is also noteworthy that Riverside's "enhanced" case management group (which had 
lower registrant-to-staff ratios) did not have larger impacts on earnings or AFDC payments than the 
"regular" case management group (where registrant-to-staff ratios were higher). (See Chapter 4.) It 
should be realized, however, that lowering caseloads from around 1(X) registrants per case manager 
to about 50 (the caseload sizes used in this study) represents a more marginal change in the burden 
imposed on case managers than would a reduction from much higher levels, such as 200-to-l or 300- 
to-1, which are sometimes found in other JOBS programs. In other words, it is questionable whether 
or not Riverside could have achieved its same level of impacts if its staff had caseloads that greatly 
exceeded 100-to-l (the size for staff in the "regular" group). 
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TABLE A.1 



SELECTED CHARACTERISTICS OF THE GAIN 
NEW JOBS MANDATORY RESEARCH SAMPLE AT ORIENTATION 



Sample and Characteristic 



Alameda 



Riverside 



Tulare 



Aid status (a) (%) 
Applicant 

Short-term recipient 
Long-term recipient 

Received AFDC continuously for at 
least 6 years prior to orientation (%) 

Employed within past 2 years (%) 

Currently employed up to 
29 hours per week (b) (%) 

Has a high school diploma or GEO (%) 

In need of basic education, 
according to GAIN criteria (%) 

Currently in a school or training program (%) 

Ethnicity (%) 
White. non-Hispanic 
Hispanic 

Black, non-Hispanic 
Indochinese 
Other Asian 
Other 

Limited English proficiency (%) 

Refugee (%) 

Age (years) (%) 
Less than 25 
25-34 
35-44 
45 or older 

Average age (years) 

Average number of children 

Has at least one child 

in the foltowing age groups (c) (%) 

Less than 6 

6-11 

12-18 

19 or older 

Research sample status (%) 
Experimental 
Control 

Sample size 



0,0 
0,0 
100,0 



44,4 

35,7 

3,8 
58,6 

63,8 
19.1 



19,1 
10,6 
67,0 
0,8 
0,5 
1,9 

0,3 

1,1 



18.5 
50,4 
25.9 
5,2 

31.1 

2,3 



100.0 
47.4 
34,6 
0.0 



52,0 
48,0 

367 



19,7 
25,0 
55,3 



16,0 
43,7 

3.8 
51,0 

60,1 
16.3 



49.8 
30.5 
15.2 
1.1 
1.4 
2.0 

4.2 

1.8 



25.3 
59.0 
13.4 
2.3 

28.9 

2.1 



99.1 
50.8 
17.3 
0.2 



79.6 
20.4 

1820 



3.0 
23.1 
73.8 



28.0 
41.8 

4.7 
45.2 

65.1 
17.8 



46.9 
43.8 
2.8 
0.2 
2.8 
3.4 

5.7 

3.0 



20.5 
58.6 
17.2 
3.7 

29.9 

2.3 



97.6 
57.0 
21.5 
0.2 



58.4 
41 .6 

493 



(continued) 
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TABLE A. 1 (continued) 



SOURCE: MDRC calculations from GAIN intake forms for the main research sample. 

NOTES: Sample characteristics were recorded on the intake form by GAIN staff at orientation and 
are based on answers from GAIN registrants. 

Distributions may not add to 100.0 percent because of rounding or because of items missing from some 
sample members' intake forms. 

A chi-square test was applied to differences among counties. Statistical significance levels are indicated as 
*** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) Applicants are registrants applying for AFDC at the time of referral to GAIN orientation; they include 
reapplicants who may have had prior AFDC receipt. Short-term recipients have received AFDC for two years or less. 
Long-term recipients have received AFDC for over two years. 

(ITie AFDC receipt may not have been continuous.) 

(b) Missing responses, which accounted for approximately 15 percent of the sample, were considered not to 
be currently employed up to 29 hours per week. 

(c) Distributions may add to more than lOO.O percent because sample members can have children in 
more than one category. 
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FIGURE A.1 



OVERVIEW OF THE INTAKE AND RANDOM ASSIGNMENT PROCESS 
FOR THE GAIN EVALUATION 
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APPENDIX B 



SURWY RESPONSE ANALYSIS 



Data on certain participation measures, job quality, perceptions of work and welfare, and other 
non-wage outcomes for this report came primarily from the GAIN registrant survey. This survey was 
administered to a stratified random subsample of the full research sample of experimentals and controls 
in five of the six research counties.^ Not all sample members selected for the survey could be inter- 
viewed, however. Some could not be located, and some refused or were unable to be interviewed. 
Sample members who completed the survey are called respondents. Sample members selected for the 
survey who did not complete it are called nonrespondents. The sample of respondents and non- 
respondents is the survey sample. In GAIN, respondents made up four-fifths of the survey sample. 
The survey sample in addition to those who were not selected to be surveyed is called thtfull research 
sample. 

Whenever survey response rates are less than 100 percent, two kinds of biases may be present. 
First, if experimentals and controls respond differently, then the cliaracteristics of the two research 
groups may be dissimilar. If this is the case, the fundamental comparison between experimentals and 
controls may be invalid, and impact estimates may be biased. Second, the sample of completed 
surveys may not well represent the full sample of program registrants who were selected for interview- 
ing. In that case, the impact estimates for survey respondents may not easily generalize to all program 
registrants. 

This appendix presents an analysis of survey response patterns undertaken to determine (a) 
whether impact estimates based on survey data would be biased by the absence of completed interviews 
for some sample members and (b) whether impact estimates based on the survey data can be 
generalized to the full research sample (which includes survey respondents, survey nonrespondents, 
and individuals not selected to be surveyed). Such an analysis is routinely performed in field studies 
using survey data.*^ 

To summarize the results of the analysis of survey response for the GAIN AFDC-FG sample*^ 
(presented below), the overall rate of response for both the experimental and control group was 
approximately 80 percent, high enough to reduce substantially the likelihood of severe bias for impacts 
based on survey data. The pre-random assignment characteristics of experimental and control res- 
pondents do not appear to have been markedly dissimilar, which indicates that the impact estimates 
based on survey data should be valid; however, some differences were found between respondents and 
nonrespondents. The most important instance was in Los Angeles, where a large difference was 



Butte was not included in the registrant survey because of the evaluation's limited survey budget. 

^The issue of item nonresponse — i.e., the failure to respond to a given question or set of questions — 
is not examined here. In most instances, item nonresponse was quite low for individuals who otherwise 
responded to the survey. Ranges oi response rates for individual items on the survey are presented where 
appropriate in the tables for Chapters 2 and 5. 

^No impacts based solely on survey measures are presented for AFDC~U registrants in this report except 
for Table C.2, which presents estimated impacts on participation in employment-related activities based on 
registrant survey data only; therefore, AFDC-Us were not included in the analysis of survey response. 
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observed in post-random assignment earnings between controls who responded to the survey and the 
full sample of controls. This pattern suggests that impacts on earnings, welfare payments, and other 
measures might not be reliable if calculated using the Los Angeles survey data. For this reason, no 
impacts on such measures calculated directly from registrant survey data are presented for Los Angeles 
in this report. For the other four survey counties, the analysis suggests that any biases in impacts for 
survey measures are probably quite small within the survey respondent sample. In addition, earnings 
data indicate that survey impact estimates related to work are probably good estimates of behavior in 
the full research sample. At the same time, however, the welfare behavior of the survey respondents 
during the follow-up period differs from the behavior of the rest of the research sample, which 
suggests that impacts estimated on certain survey measures related to welfare behavior may be 
somewhat larger than would be impacts on similar measures if those were available for the full sample. 



L Comparisons Between Experimentals and Controls in the Survey Respondent Sample 

Table B.l gives the number of survey completions and the response rates for experimentals and 
controls in each county and in all counties combined. The total rate of response for all counties 
combined was 80.0 percent, matching the targeted response rate. This response rate was high enough 
to suggest that the survey probably represents the full research sample quite well. Across counties, 
response rates ranged from 78.5 percent in San Diego to 83.8 percent in Tulare, a modest amount of 
variation. More important is that none of the counties had a very low response rate. Within 
experimental and control groups, overall response rates for all counties combined were similar (79.3 
percent for experimentals compared to 80.8 percent for controls). In addition, none of the 
experimental-control differences within counties was large or statistically significant. 

To further assess the importance of any experimental-control differences within the survey 
respondent sample, the 0/1 dummy variable indicating membership in the experimental group was 
regressed on pre-random assignment demographic information using the survey sample alone. This 
was done for each county separately. All regression R-squares were under 0.030 and none was 
statistically significant, indicating that research group membership was not related to pre-random 
assignment characteristics. These results, in conjunction with the findings related to response rates 
discussed above, support the conclusion that the fundamental comparison of experimental and control 
survey respondents should not produce biased impact estimates. 

Other evidence, however, suggests that in Los Angeles, impacts calculated for the survey 
respondent sample may not be reliable. Average earnings calculated from Unemployment Insurance 
(UI) data covering the first two years of follow-up were about $1,100 lower for survey respondent 
controls than for the full research sample of controls, a large difference that may have resulted from 
differences in unobserved personal characteristics or may simply be the result of chance. Whatever 
the reason, the difference led to two-year UI earnings impacts for the survey respondent sample in Los 
Angeles that were about $1,700 larger than impacts for the full research sample in that county. This 
is by far the largest discrepancy in earnings impacts among the five survey counties. The other 
discrepancies are only about $150 or less. In light of these findings, this report does not present 
survey-based measures for controls or experimental -control differences in Los Angeles. At the same 
time, for experimentals in Los Angeles, the earnings discrepancy between survey respondents and the 
full research sample was much smaller than for controls. Therefore, this report does present survey- 
based estimates for Los Angeles experimentals alone. Moreover, the small size of the discrepancies 
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TABLE B.1 



RESPONSE RATES AMONG AFDC-FG REGISTRANTS TO THE GAIN REGISTRANT SURVEY, 

BY COUNTY AND RESEARCH GROUP 

County and ' Number of Response 
Research Group Completions Rate (%) 

Alameda 

Experimentals 335 78.1 

Controls 348 81.1 

Total 683 79.6 

Los Angeles 

Experimentals 223 78.0 

Controls 230 80.4 

Total 453 79.2 

Riverside 

Experimentals 674 78.6 

Controls 342 79.7 

Total 1016 78.9 

San Diego 

Experimentals 337 78.7 

Controls 336 78.3 

Total 673 78.5 

Tulare 

Experimentals 356 83.0 

Controls 363 84.6 

Total 719 83.8 

All counties 

Experimentals 1925 79.3 

Controls 1619 80.8 

Total 3544 80.0 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: A response rate is the number of survey completions taken as a percentage of sample members 
selected to be surveyed. 

Butte County was not included in the survey. 

In the all -county average, the results of each county are weighted equally. 

A chi -square test was applied to differences in response rates between experimentals and controls in 
each county and for all counties combined. Statistical significance levels are indicated as *** = 1 percent; 
** = 5 percent; * = 10 percent. 
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in the other counties indicates that survey impact estimates related to earnings (e.g., job quality) are 
probably good estiixiates of behavior in the full research sample. 



11. Comparisons Between Survey Respondents and the Full Research Sample 

In addition to examining the characteristics of experimentals and controls within the survey 
respondent sample, the characteristics of survey respondents (experimentals and controls combined) 
were compared to those of survey ;z<?/2respondents. This can help determine whether or not the impact 
estimates for the survey respondent sample can be generalized to the full research sample. To assess 
the potential importance of any observed differences in pre-random assignment characteristics between 
survey respondents and survey nonrespondents, the 0/1 dummy indicating survey response versus 
survey nonresponse was regressed on pre-random assignment demographic information, for each 
county separately, using the survey sample of respondents and nonrespondents combined. The 
regression R-squares were slightly larger in this case than in the first set of regressions (discussed 
above), ranging from 0.036 to 0.064 across the counties, and were statistically significant in all 
counties except Los Angeles. In most counties, survey respondents were more likely than 
nonrespondents to be nonwhite, female, and to have had longer welfare histories prior to random 
assignment. 

Because respondents tended to have longer welfare histories than nonrespondents, they also 
received more AFDC during the period following random assignment. In Tulare, the average AFDC 
payment and the impact on AFDC payments over the first two years were similar for survey 
respondents and the full research sample. In each of the other four survey counties, both the average 
AFDC payment and the impact on AFDC payments were larger for respondents. Averaging those four 
counties (with each county weighted equally) indicates that respondent controls received about 8 
percent more AFDC than the full control sample; in addition, the average AFDC impact for 
respondents was $1,382, compared to $830 for the full research sample in those four counties. Any 
impacts on survey measures of AFDC receipt would therefore also tend to be larger for the survey 
respondent sample than for the full research sample. It is possible that impacts on other survey 
measures related to AFDC receipt, such as attitudes toward welfare, could be larger as well. 
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TABLE C.1 



RATES OF PARTICIPATION IN GAIN ACTIVITIES AMONG AFDC-U EXPERIMENTALS 
WITHIN 11 MONTHS AFTER ORIENTATION 



Sample and 
Participation Status 



Alameda 



All experimentals 

Ever participated in any GAIN 
activity, excluding appraisal 
and assessment (%) 

Ever deferred (%) 

Reason for first deferral among 
those ever deferred (%) 

Part-time employment 

Illness 

Other reasons 
Total 

Ever participated in (%) 
Job search 
Basic education (b) 

GED 

ABE 

ESL 

Self- initiated activity 
Assessment 

Post-assessment activity 
Any education or 
training activity 



Sample size 



56.3 
55.2 



43.4 

30.2 
26,4 
100.0 



14.6 
41.7 
4.2 

10.4 
28.1 

2.1 

9.4 

9.4 (c: 
51.0 
96 



(C) 



Experimentals who started 
any GAIN activity (e) 

Participated in (%) 
Job search 
Basic education (f) 
Self-initiated activity 
Post-assessment activity 
Any education or 
training activity 

Sample size 



25.9 
74.1 
3.7 (C) 
16.7 (C) 

90.7 

54 



Butte 



Los 
Angeles 



Riverside San Diego 



SOURCE: Calculations using data from the MDRC participant flow study. 

NOTES: Distributions may not add to 100.0 percent because of rounding. 

A chi-square test was applied to differences among counties. Statistical significance levels are 
indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) A test of statistical significance was not performed . 

(b) Subcategory percentages may not add to the category percentage because participation In 
more than one component of basic education was possible. 

(c) Alameda registrants already in vocational education at orientation were coded as participating 

in vocational education instead of in self- initiated vocational education. This policy causes the post -assessment 
activity percentage, which includes vocational education, to be higher and the self- Initiated activity percentage to 
be lower than If the coding had been consistent with that in the other counties. 

(d) A test of statistical significance was not applicable. 

(e) This sample includes only those experimentals who ever participated in any GAIN activity, 
excluding appraisal and assessment. 

(f) GED preparation. ABE. and ESL. 



Tulare 



38.4 


36 .0 


DD.U 


*tD.O 


CQ 7 *** 


12.1 


69.6 


42.2 


63.8 


49.2 *** 


4 c: "7 


Oo.O 




47 4 


23.0 (a) 


33.3 


35.7 


21.0 


11.6 


18.0 (a) 


50.0 


10.7 


46.8 


41.1 


59.0 (a) 


100.0 


100.0 


100.0 


100.0 


100.0 


16.2 


O.U 


AO O 




16.1 *** 


20.2 






OA 0 




1U. 1 






fi 7 


13.7 *** 


1.0 


4.8 


6.8 


11.4 


16.9 *** 


9.1 


23.4 


14.3 


7.4 


13.7 *** 


3.0 


3.4 . 


6.8 


5.4 


7.3 


9.1 


1.1 


4.1 


11.4 


14.5 *** 


2.0 


0.1 


2.0 


6.7 


6.5 (d) 


25.3 


32.7 


32.0 


33.6 


52.4 *** 


99 


736 


147 


149 


124 


42.1 


14.0 


63.9 


47.8 


27.0 *** 


52.6 


81.9 


39.2 


52.2 


70.3 *** 


7.9 


9.4 


10.3 


11.6 


12.2 


5.3 


0.4 


3.1 


14.5 


10.8 (d) 


65.8 


90.9 


48.5 


72.5 


87.8 *** 


38 


265 


96 


69 


74 
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TABLE C.2 

GAIN'S ESTIMATED IMPACTS ON THE PERCENTAGE OF REGISTRANTS WHO EVER PARTICIPATED 
IN EMPLOYMENT- RELATED ACTIVITIES WITHIN TWO TO THREE YEARS AFTER ORIENTATION. 

BASED ON REGISTRANT SURVEY DATA ONLY 



AFDC-FGs AFDC-Us (a) 



Outcome and 




Los 








All 

All 


A II 

All 


Research Group 


Alameda 


Angeles 


Riverside 


San Diego 


Tulare 


Counties 


Counties 


Ever participated in job search 
















Experimentals (%) 


16.7 


7.2 


18.7 


22.9 


17.4 


16.6 


15.3 


Controls (%) 


2.9 


0.0 


0.9 


6.3 


1.4 


2.3 


3.1 


Difference 


13.8 


7.2 


17.8 


16.6 


16.0 


14.3 


12.1 


Ever participated In ABE/GED 
















Experimentals (%) 


32.2 


22.9 


10.2 


18.7 


21.6 


21.1 


14.5 


Controls (%) 


6.0 


4.4 


3.2 


4.5 


3.9 


4.4 


2.0 


Difference 


26.2 


18.5 


7.0 


14.2 


17.7 


16.7 


12.5 


Ever participated in ESL 
















Experimentals (%) 


2.1 


8.5 


2.1 


5.0 


1.7 


3.9 


8.8 


Controls (%) 


0.3 


4.8 


2.1 


2.7 


1.7 


2.3 


3.4 


Difference 


1.8 


3.7 


0.0 


2.3 


0.0 


1.6 


5.4 


Ever participated in vocational 
















training or post-secondary 
















education 
















Experimentals (%) 


32.2 


15.7 


30.9 


36.5 


32.6 


29.6 


15.5 


Controls (%) 


26.2 


11.7 


33.0 


33.3 


24.2 


25.7 


17.0 


Difference 


6.0 


4.0 


-2.1 


3.2 


8.4 


3.9 


-1.5 


Ever participated in unpaid 
















work experience 
















Experimentals (%) 


3.6 


0.9 


0.6 


4.5 


5.1 


2.9 


1.0 


Controls (%) 


0.6 


0.0 


0.6 


1.2 


0.8 


0.6 


0.0 


Difference 


3.0 


0.9 


0.0 


3.3 


4.3 


2.3 


1-0 


Ever participated in OJT 
















Experimentals (%) 


2.7 


2.7 


8.0 


5.6 


3.9 


4.6 


5.2 


Controls (%) 


0.6 


2.2 


1.5 


1.5 


2.2 


1.6 


3.5 


Difference 


2.1 


0.5 


6.5 


4.1 


1.7 


3.0 


1.7 


Sample size 
















Experimentals 


335 


223 


674 


337 


356 


1925 


201 


Controls 


348 


230 


342 


336 


363 


1619 


207 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 



NOTES: Calculations for this table used data for all program tracking sample members and survey respondents, including 
those who did not participate in the activity. 

Rounding may cause slight discrepancies in calculating sums, averages, and differences. 

Tests of statistical significance of the differences between experimentals and controls were not performed. 

In the all -county averages, the results for each county are equally weighted. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties where the 
registrant survey was conducted. Butte County was not included in the survey. 

(a) The AFDC-U sample does not include any registrants from Alameda. 
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TABLE C.3 

FOR THOSE DETERMINED NOT TO NEED BASIC EDUCATION: 
GAIN'S ESTIMATED IMPACTS FOR AFDC-FGs ON NUMBER OF MONTHS PARTICIPATING IN 
EMPLOYMENT-RELATED ACTIVITIES WITHIN FIVE YEARS AFTER ORIENTATION 



Outcome and Los All 

Research Group Alameda Butte Angeles Riverside San Diego Tulare Counties 



Average number of months in 
job search 



Experimentals 


1.5 


1.0 


0.8 


1.5 


0.9 


1.3 


1.2 


Controls 


0.1 


0.2 


0.1 


0.2 


0.4 


0.0 


0.2 


Difference 


1.4 


0.9 


0.7 


1.3 


0.5 


1.3 


1.0 



Average number of months in 
ABE/GED 

Experimentals 

Controls 

Difference 



0.7 
0.2 
0.5 



0.1 
0.1 
0.0 



0.4 
0.1 
0.3 



0.0 
0.0 
-0.0 



0.0 
0.0 
-0.0 



0.3 
0.2 
0.2 



0.2 
0.1 
0.1 



Average number of months in 
ESL 

Experimentals 

Controls 

Difference 



0.1 
0.0 
0.1 



0.0 
0.0 
-0.0 



0.0 
0.0 
0.0 



0.0 
0.0 
0.0 



0.1 
0.1 

-0.1 



0.0 
0.0 

0.0 



0.0 
0.0 
0.0 



Average number of months in 
. vocational training or post- 
secondary education 



Experimentals 


7.9 


5.0 


3.7 


4.5 


5.5 


6.2 


5.5 


Controls 


4.4 


5.0 


2.9 


6.5 


5.9 


5.4 


5.0 


Difference 


3.5 


-0.0 


0.8 


-2.0 


-0.3 


0.8 


0.5 



Average number of months in 

unpaid work experience 

Experimentals 0.7 0.5 

Controls 0.0 0.0 

Difference 0.7 0.4 



0.2 0.0 0.3 0.0 0.3 

0.0 0.0 0.0 0.1 0.0 

0.2 -0.0 0.3 -0.0 0.3 



Sample sizes 
Program tracking data 
Experimentals 
Controls 

Registrant survey data 
Experimentals 
Controls 



2D9 
n/a 



109 
106 



92 
n/a 



n/a 
n/a 



583 
n/a 



81 
n/a 



282 
148 



110 
n/a 



146 
147 



79 

n/a 



140 
137 



1154 
n/a 



677 
538 



SOURCE: See Tables 2.3 and 2.4. 



NOTES: See Tables 2.3. 2.4. and 2.7. 

Tests of statistical significance of the differences between experimentals and controls were not performed. 
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TABLE C.4 



FOR IHOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S ESTIMATED IMPACTS FOR AFDC-FGs ON NUMBER OF MONTHS PARTICIPATING IN 
EMPLOYMENT-RELATED ACTIVITIES WITHIN FIVE YEARS AFTER ORIENTATION 



Outcome and 
Research Group 


Alameda 


Butte 


Los 
Angeles 


Riverside 


San Oiego 


Tulare 


A II 

All 

Counties 


Average number of months in 
job search 

Experimental 

Controls 

Difference 


0,3 

0.2 

0,1 


0.4 
0,2 
0,2 


0.8 
0.1 
0.7 


0.8 
0.0 
0.7 


1.1 
0.4 
0,7 


0.2 
0,0 
0,2 


0.6 
0.1 
0.4 


Average number of months in 
ABE/GED 

Experimentals 

Controls 

uinerence 


6,2 
0.7 
o,o 


3,1 
0.7 

dA 


3.5 
0.6 


1.9 
0.6 

i Q 

1 ,o 


1.9 
0.8 
1 .1 


5,6 
0,6 
5,0 


3.7 
0.7 
3,0 


Average number of months in 
ESL 

Experimentals 

Controls 

Difference 


0,6 
0,1 
0,5 


1.7 
0.3 
1.4 


1.8 
0.2 
1.5 


0.7 
0.2 
0.4 


0.8 
0.2 
0.6 


1,8 
0.8 
1.1 


1,2 
0,3 
0,9 


Average number of months in 
vocational training or post- 
secondary education 

Experimentals 

oonirois 

Difference 


2,9 
0,6 


1.5 

1 7 

-0.2 


1.7 
G.9 


1.4 
-0.8 


2.4 
0.2 


1.7 
1 .1 
0.5 


1,9 

•1 7 
1 ,f 

0.2 


Average number of months in 
unpaid work experience 

Experimentals 

Controls 

Difference 


0,1 
0,0 
0,0 


0.2 
0.0 
0.2 


0.0 
0.0 
-0.0 


0.1 
0.0 
0.1 


0.7 
0.0 
0.7 


0.0 
0.0 
-0.0 


0.2 
0,0 
0,2 


Sample sizes 
Program tracking data 
Experimentals 
Controls 


393 
n/a 


108 
n/a 


2430 
n/a 


167 
n/a 


137 
n/a 


146 

n/a 


3381 
n/a 


Registrant survey data 
Experimentals 
Controls 


226 
242 


n/a 
n/a 


189 


392 
194 


191 
189 


216 
226 


1214 
851 



SOURCE; See Tables 2.3 and 2.4. 

NOTES: See Tables 2.3, 2.4, and 2.8. 

Tests of statistical significance of the differences between experimentals and controls were not performed. 
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TABLE C.5 



GAIN PARTICIPATION PATTERNS WITHIN 1 1 MONTHS AFTER ORIENTATION 
AMONG SELECTED SUBGROUPS OF AFDC-FG EXPERIMENTALS 



Sample 
and Measure 



Alameda 



Butte 



Los 
Angeles 



Riverside San Diego 



Registrants determined 
not to need basic education 

Ever participated in (%) 
Any GAIN activity 
sJob searcli 
Basic education (a) 
Self- initiated activity 
Post-assessment activity 
Any education or training activity 

Ever in conciliation, sanctioned, 
or slated for sanctioning (%) 

Sample size 



61.7 
49.8 
6.7 
5.3 
32.5 
37.8 



(C) 

(c) 



1.9 

209 



48.9 
32.6 

1.1 
15.2 

7.6 
20.7 



9.8 
92 



40.3 
24.7 
3.8 

13.6 
4.3 
21.3 



38.6 
583 



65.4 
45.7 

0.0 
23.5 

1.2 
24.7 



27.2 



81 



60.0 
38.2 
0.0 
22.7 
14.5 
30.0 



23.6 
110 



Tulare 



62.0 *** 
43.0 *** 
2.5 (b) 
17.7 *** 
15.2 *** 
32.9 *** 



12.7 (b) 
79 



Registrants determined 
to need basic education 

Ever participated in (%) 
Any GAIN activity 
Job search 
Basic education (a) 
Self- initiated activity 
Post-assessment activity 
Any education or training activity 

Ever in conciliation, sanctioned, 
or slated for sanctioning (%) 

Sample size 



63.9 
14.0 

55.5 
2.0 (c) 
9.2 (c) 

61.1 



2.3 

393 



37.0 
5.6 

26.9 
5.6 
0.9 

33.3 



10.2 
108 



53.9 
8.8 

44.8 
4.5 
0.4 

49.2 



33.5 
2430 



57.5 
28.7 
32.3 
8.4 
3.0 
41.9 



37.1 
167 



51.1 
22.6 
34.3 
9.5 
2.9 
43.1 



19.7 
137 



60.3 *** 

8.2 *** 

54.8 *** 
2 '\ *** 

6.2 *** 
58.2 *** 



11.0 (b) 
146 



Applicants 

Ever participated in (%) 



Any GAIN activity 




37.4 




59.4 


60.0 


36.4 *** 


Job search 




MA 




30.4 


43.8 


12.1 *** 


Basic education (a) 




11.3 




20.3 


13.8 


24.2 


Self-initiated activity 




9.6 




13.0 


12.5 


0.0 


Post-assessment activity 




1.7 




1.4 


7.5 


6.1 (b) 


Any education or training activity 




21.7 




34.8 


30.0 


27.3 



Ever in conciliation, sanctioned, 
or slated for sanctioning (%) 

Sample size 



12.2 
115 



46.4 
69 



32.5 
80 



24.2 (b) 
33 



Short-term recipients 
Ever participated in (%) 



Any GAIN activity 




40.9 




53.8 


53.8 


56.9 


Job search 




22.7 




28.8 


27.7 


25.5 


Basic education (a) 




13.6 




21.3 


20.0 


27.5 


Self- initiated activity 




9.1 




11.3 


13.8 


5.9 


Post-assessment activity 




18.2 




3.8 


12.3 


9.8 


Any education or training activity 




36.4 




33.8 


35.4 


39.2 



Ever in conciliation, sanctioned, 
or slated for sanctioning (%) 

Sample size 



9.1 
22 



31.7 
80 
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17.2 
65 



11.8 (b) 
51 

(continued) 



TABLE C,5 (continued) 



Sample 
and Measure 



Alameda 



Butte 



Los 
Angeles 



Riverside San Diego 



Long -term recipients 

Ever participated in (%) 

Any GAIN activity 63.1 

Job search 26.4 

Basic education (a) 38.5 

Self-initiated activity 3.2 (c) 

Post-assessment activity 17.3 (c) 

Any education or training activity 53.0 

Ever In conciliation, sanctioned, 

or slated for sanctioning (%) 2.2 



Sample size 



602 



52.4 
17.5 
22.2 
11.1 
3.2 
34.9 



6.3 
63 



51.3 
11.9 
36.8 
6.2 
1.1 
43.8 



34.5 
3013 



65.7 
41.4 
23.2 
15.2 
2.0 
39.4 



26.8 
99 



52.0 
19.6 
22.5 
18.6 
5.9 
44.1 



15.5 
102 



SOURCE: Calculations using data from the MDRC participant flow study. 



Tulare 



68.1 *** 
20.6 *** 
42.6 *** 

g g *** 

9.9 *** 

58.2 *** 



8.5 (b) 
141 



NOTES: A chi-square test was applied to differences among counties. Statistical significance levels are indicated as 
*** = 1 percent; ** = 5 percent; * = 10 percent. 

Dashes indicate that the sample size is under 20; therefore, the calculation has been omitted. 

(a) GED preparation. ABE, and ESL. 

(b) Atestofstatisticalsignificance was not applicable. . ^ *• 

(c) Alameda registrants already in vocational education at orientation were coded as participating in vocational education 
instead of in self- initiated vocational education. This policy causes the post -assessment activity percentage, which includes 
vocational education, to be higher and the self-initiated activity percentage to be lower than if the coding had been consistent 
with that in the other counties. 
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APPENDIX D 
SUPPLEMENTAL TABLES TO CHAPTER 4 



TABLE D.I 

AVERAGE IMPACTS IN SELECTED STUDIES OF STATE WELFARE -TO -WORK PROGRAMS 

FOR AFDC-FGs {SINGLE PARENTS) 



Average Total Earnings ($) Average Total AFDC Payments ($) 



Program 


Year 1 


Year 2 


Year 3 


Year 1 


Year 2 


Year 3 


California GAIN (a) 
Alameda 
Butte 

Los Angeles 
Riverside 
San Diego 
Tulare 


266 *** 
209 
272 
-4 

920 *** 
349 ** 
-149 


512 *** 
508 * 
556 
110 
1183 *** 
709 *** 
5 


636 *** 
774 ** 
647 
153 
1010 *** 
713 *** 
518 ** 


-283 *** 
-150 
-353 * 
-328 *** 
-695 *** 
-302 *** 
132 


-347 *** 
-261 
-333 
-401 *** 
-703 *** 
-480 *** 
95 


—331 *** 
-371 ** 
-290 
-277 ** 
-584 *** 
-353 *** 
-113 


Arkansas WORK 
Program 


167 ** 


223 


337 ** 


-145 *** 


-190 *** 


-168 *** 


Louisville WIN Lab- 
Individual Job Search (b) 


289 ** 


456 ** 


435 ** 


-75 * 


-164 ** 


-184 ** 


Cook County 
WIN Demonstration 


10 


n/a 


n/a 


-40 


n/a 


n/a 


Louisville WIN Ub- 
Group Job Search (b) 


464 ** 


n/a 


n/a 


-40 


n/a 


n/a 


West Virginia 
CWEP 


"6 


n/a 


n/a 


0 


n/a 


n/a 


Virginia ESP 


69 


280 ** 


268 * 


-69 


-36 


-111 ** 


San Diego 1 (EPP/EWEP) 


443 *** 


n/a 


n/a 


-226 *** 


n/a 


n/a 


San Diego SWIM (c) 


352 *** 


644 *** 


555 *** 


-419 *** 


-560 *** 


-483 *** 


Baltimore Options 


140 


401 *** 


511 *** 


2 


-34 


-31 



SOURCE: Gueronand Pauly, 1991 ; Riccio and Friedlander, 1992; Friedlanderand Hamilton, 1993. 



NOTES: * Denotes statistical significance at the 10 percent level; ** at the 5 percent level; and *** at the 1 percent 
level. 

Where data are not available, "n/a" is used. 

(a) Impacts were obtained by weighting each of six counties equally. 

(b) The impacts are adjusted to 1985 dollars. 

(c) All SWIM data contained in this table have been taken from Friedlander and Hamilton. 1993. 
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TABLE D.2 



ALAMEDA AFDC-FGs: IMPACTS ON EMPLOYMENT, EARN'.NGS. 
AFDC RECEiPT, AND AFDC PAYMENTS 



Outcome and Follow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-1 3) 

Average number of quarters with 
employment 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter? 
Quarter 8 
Quarter 9 
Quarter 1 0 
Quarter 1 1 
Quarter 1 2 
Quarter 1 3 
Quarter 1 4 
Quarter 1 5 
Quarter 1 6 



30.1 
32,8 
33,9 
48.8 



0,75 
0.86 
0.96 
2.57 



13.7 
16.6 
18.5 
20.0 
20.1 
19.0 
20.1 
21.9 
24.5 
24.9 
23.7 
22.6 
24.8 



27.3 
26.3 
26.7 
40.8 



0.68 
0.72 
0.81 
2.22 



16.2 
16.3 
17.7 
17.3 
17.1 
17.0 
18.6 
18.2 
18.5 
19.9 
21.1 
21.0 
18.8 



2.8 
6.5 
7.2 
8.0 



*** 
*** 
*** 



0.07 
0.13 
0.15 
0.35 



-2.5 
0.2 
0.8 
2.7 
3.0 
2.0 
1.6 
3.7 
6.1 
4.9 
2.6 
1.6 
6.0 



10.1% 
24.8% 
26.9% 
19.5% 



9.9% 
18.5% 
18.8% 
15.9% 



-15.6% 
1 .5% 
4.4% 
15.7% 
17.8% 
1 1 .8% 
8.5% 
20.3% 
33.0% 
24.8% 
12.5% 
7.5% 
32.0% 



Average total earnings ($) 



Year 1 (quarters 2-5) 


1421 


1212 


209 


17.3% 


Year 2 (quarters 6-9) 


2132 


1624 


508 * 


31 .3% 


Year 3 (quarters 10-13) 


2880 


2105 


774 ** 


36.8% 


Total (quarters 2-1 3) 


6432 


4941 


1492 ** 


30.2% 


Werage total earnings ($) 










Quarter of random assignment 


171 


210 


-39 * 


-18.8% 


Quarter 2 


251 


267 


-16 


-5.8% 


Quarter 3 


340 


300 


40 


13.4% 


Quarter 4 


414 


344 


70 


20.2% 


Quarter 5 


416 


301 


115 ** 


38.1% 


Quarter 6 


457 


348 


109 


31 .2% 


Quarter 7 


484 


391 


93 


23.7% 


Quarter 8 


531 


433 


97 


22.5% 


Quarter 9 


660 


451 


209 ** 


• 46.4% 


Quarter 10 


702 


466 


235 *** 


50.4% 


Quarter 1 1 


719 


534 


185 * 


34.6% 


Quarter 1 2 


693 


556 


137 


24.7% 


Quarter 1 3 


766 


549 


217 ** 


39.6% 


Quarter 1 4 










Quarter 15 










Quarter 1 6 











(continued) 



TABLE D.2 (continued) 



Outcome and Follow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever received any AFDC payments (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of months receiving 
AFDC payments 

Year 1 (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever received any AFDC payments (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 
Quarter 16 



Average total AFDC payments received ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6- 9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 



97.0 
85.4 
76.5 
97.3 



10.79 
9.43 
8.32 

28.54 



99.4 
97.0 
94.1 
89.8 
86.0 
83.3 
82.3 
78.8 
76.6 
74.8 
71.3 
70.0 
67.5 



6916 
5816 
4861 
17593 



98.5 
88.0 
77.7 
98.9 



10.99 
9.64 
8.62 

29.25 



99.5 
98.0 
94.8 
91.3 
89.2 
86.8 
83.5 
79.9 
77.1 
75.6 
74.1 
72.3 
70.6 



7066 
6077 
5232 
18375 



-1.5 ** 
-2.6 
-1.2 
-1.5 *♦ 



-0.20 
-0.21 
-0.30 
-0.71 



-0.1 

-1.0 

-0.7 

-1.6 

-3.2 ' 

-3.5 ' 

-1.1 

-1.1 

-0.5 

-0.7 

-2.9 

-2.3 

-3.1 



-150 
-261 
-371 ** 
-782 * 



-1.5% 
-2.9% 
-1.5% 
-1.6% 



-1.8% 
-2.2% 
-3.5% 
-2.4% 



-0.1% 
-1.0% 
-0.8% 
-1.7% 
-3.6% 
-4.0% 
-1.4% 
-1.4% 
-0.7% 
-1.0% 
-3.9% 
-3.2% 
-4.4% 



-2.1% 
-4.3% 
-7.1% 
-4.3% 



Quarter of random assignment 


1918 


1925 


-7 


-0.3% 


Quarter 2 


1861 


1865 


-4 


-0.2% 


Quarter 3 


1758 


1784 


-26 


-1.5% 


Quarter 4 


1677 


1737 


-60 * 


-3.5% 


Quarter 5 


1620 


1680 


-60 


-3.6% 


Quarter 


1552 


1637 


-84 ** 


-5.2% 


Quarter 7 


1485 


1543 


-58 


-3.8% 


Quarter 8 


1420 


1478 


-57 


-3.9% 


Quarter 9 


1359 


1420 


-61 


-4.3% 


Quarter 10 


1299 


1376 


-78 


-5.6% 


Quarter 1 1 


1239 


1339 


-100 ** 


-7.5% 


Quarter 12 


1193 


1283 


-90 * 


-7.0% 


Quarter 13 


1130 


1233 


-103 ** 


-8.3% 


Quarter 14 










Quarter 15 










Quarter 16 











Sample size (total = 1205) 



602 



603 



SOURCE AND NOTES: See Table 4.1 . Thirteen quarters of follow-up data are available for Alameda. 
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TABLE D.3 



BUTTE AFDC-FGs: IMPACTS ON EMPLOYMENT, EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Foltow~Up Period 



Experi mentals 



Controls 



Difference 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Years (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employnnCint 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 13 
Quarter 14 
Quarter 1 5 

Quarter 1 6 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Years (quarters 10-13) 
Total (quarters 2-13) 

Average total earnings ($) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 1 6 



42.3 
46.3 
46.7 
63.4 



1.04 
1.26 
1.32 
3.61 



22.5 

22.5 

25.0 

27.0 

29.1 

29.9 

31.4 

32.3 

32.0 

32.7 

33.5 

32.9 

32.9 

33.2 



2001 
2998 
3638 
8637 



273 

386 

467 

557 

591 

661 

733 

801 

803 

863 

890 

948 

937 

988 



45.6 
42.2 
42.5 
63.7 



0.99 
1.10 
1.17 
3.26 



20.4 
23.4 
25.4 
23.4 
26.8 
27.1 
27.7 
27.4 
27.5 
27.6 
29.9 
30.3 
29.6 
30.2 



1729 
2442 
2992 
7163 



253 
354 
412 
455 
508 
556 
594 
654 
638 
634 
717 
805 
836 
685 



-3.3 
4.0 
4.3 

-0.2 



0.05 
0.16 
0.15 
0.35 



2.1 
-0.9 
-0.4 
3.6 
2.4 
2.9 
3.7 
4.8 
4.4 
5.1 
3.6 
2.6 
3.3 
3.0 



Percentage 
Change 



272 
556 
647 
1474 



20 

32 

55 
102 

83 
105 
139 
147 
165 
229 ** 
173 
143 
101 

303 ** 



-7.2% 
9.6% 
10.1% 
-0.4% 



4.8% 
14.5% 
12.4% 
10.8% 



10.3% 
-3.8% 
-1.4% 
15.5% 

8.8% 
10.6% 
13.5% 
17.6% 
16.1% 
18.6% 
12.2% 

8.5% 
1 1 .0% 
10.0% 



15.7% 
22.8% 
21 .6% 
20.6% 



8.1% 
9.0% 
13.3% 
22.5% 
16.3% 
18.9% 
23.4% 
22.4% 
25.9% 
36.1% 
24.2% 
17.8% 
12.1% 
44.2% 



(continued) 
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TABLE D.3 (continued) 



Outcome and Folbw-Up Period 

Ever received any AFDC payments (%) 
Year1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of months receiving 
AFDC payments 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Years (quarters 10-13) 

Total (quarters 2-13) 

Ever received any AFDC payments (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 1 3 
Quarter 14 
Quarter 15 
Quarter 16 



Experimental 



Controls 



Difference 



Percentage 
Change 



Average total AFDC payments received ($) 
Yearl (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average AFDC payments received ($) 
Quarter of random assignment 
Quarter 2 
Quarters 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 1 3 
Quarter 14 
Quarter 1 5 
Quarter 16 



89.3 
65.9 
51.5 
90.1 



8.60 
6.15 
10.98 
19.58 



89.8 
88.6 
79.8 
70.7 
65.0 
60.8 
56.2 
51.9 
49.4 
46.8 
43.2 
41.2 
39.7 
38.1 
35.6 



5132 
3715 
2612 
11659 



1440 
1496 
1331 
1200 
1105 
1046 
945 
887 
837 
778 
715 
683 
636 
589 
542 



90.2 
65.1 
50.5 
90.2 



8.65 
6.29 
11.31 
19.96 



90.1 
89.4 
76.4 
70.6 
68.4 
63.8 
56.7 
52.7 
47.7 
48.6 
45.3 
42.0 
41.0 
37.8 
37.2 



5486 
4048 
3101 
12635 



1493 
1565 
1385 
1312 
1224 
1176 
10B0 
916 
876 
844 
809 
743 
705 
689 
633 



-0.8 
-0.3 
1.0 
-0.1 



-0.05 
-0.13 
-0.33 
-0.38 



-0.3 
-0.7 

3.4 

0.1 
-3.4 
-3.0 
-0.4 
-0.8 

1.7 
-1.8 
-2.2 
-0.9 
-1.3 

0.3 
-1.6 



-353 
-333 
-290 
-976 



-53 

-69 

-54 
-111 * 
-118 * 
-130 * 
-135 ** 

-29 

-39 

-66 

-94 

-61 

-69 
-100 * 

-91 



-0.9% 
-0.4% 
2.1% 
-0.1% 



-0 5% 
-2.1% 
-2.9% 
-1.9% 



-0.4% 
-0.8% 

4.5% 

0.2% 
-5.0% 
-4.7% 
-0.8% 
-1.5% 

3.6% 
-3.7% 
-4.8% 
-2.1% 
-3.2% 

0.8% 
-4.3% 



-6.4% 
-8.2% 
-9.3% 
-7.7% 



-3.6% 
-4.4% 
-3.9% 
-8.5% 
-9.7% 
-11.1% 
-12.5% 
-3.1% 
-4.5% 
-7.8% 
-11.6% 
-8.2% 
-9.8% 
-14.5% 
-14.4% 



Sample size (total = 1 229) 



986 



243 



SOURCE AND NOTES: See Table 4.1. 
of AFDC data are available for Butte. 



Fourteen quarters of employment and earnings follow-up data and 15 quarters 
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TABLE D.4 



LOS ANGELES AFDC-FGs: IMPACTS ON EMPLOYMENT, EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Foltow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Yearl (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Year 1 (quarters 2-5) 

Year ? (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quan<5rs 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 13 
Quarter 14 
Quarter 15 
Quarter 16 



27.0 
26.9 
26.0 
39.4 



0.69 
0.75 
0.76 
2.21 



14,6 
16.6 
16.7 
17.8 
18.3 
18.9 
18.7 
18.8 
19.1 
19.1 
19.0 
19.0 
19.3 
19.0 



24.9 
22.9 
22.4 
34.9 



0,64 
0.67 
C.67 
1.98 



13.0 
15.0 
15.6 
16.4 
17,1 
17.6 
16.9 
16.6 
15.9 
16.8 
16,4 
17.4 
16.8 
17.1 



2.1 

4.0 *** 
3.6 *** 
4.5 *** 



0.05 
0,08 ** 
0,09 ** 
0,23 ** 



1.6 • 

1.6 

1.1 

1.4 

1.1 

1.3 

1.8 

2.2 

3.2 

2.3 

2.6 

1,7 

2.4 

1.9 



8.6% 
17.5% 
16.1% 
12.8% 



8,1% 
12.6% 
13,5% 
11,4% 



11,9% 
10.4% 
6.9% 
8.7% 
6.6% 
7.4% 
10.4% 
13.2% 
20.3% 
14.0% 
16.0% 
9.6% 
14.4% 
11.1% 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average total earnings ($) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 
Quarter 16 



1304 
1699 
1939 
4943 



195 
266 
307 
359 
372 
399 
410 
442 
448 
472 
479 
493 
495 
503 



1308 
1589 
1786 
4683 



184 
254 
313 
367 
373 
399 
399 
396 
395 
425 
424 
470 
467 
461 



-4 
110 
153 
260 



11 
12 
-7 
-8 
-1 
0 
10 
46 
53 
48 
55 
24 
28 
42 



-0.3% 
6.9% 
8.6% 
5.5% 



6.0% 
4.6% 
-2.1% 
-2.2% 
-0.3% 
0.0% 
2.6% 
1 1 .7% 
13.5% 
1 1 .2% 
12,9% 
5.1% 
5,9% 
9.1% 



(continued) 
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TABLE D.4 (continued) 



Outcome and Follow— Up Period 


tlXpe nme ma IS 


oonirotS 


unrerence 


Percentage 
k^rianye 


Ever received any AFDC payments (%) 










Year 1 (quarters 2—5) 


97.0 


97.3 


—0.3 


—0.3% 


Year 2 (quarters 6-9) 


83.0 


86.5 


—o.O 


—4.1% 


Year 3 (quarters 10-13) 


72.9 


75.2 


-2.3 


-3.0% 


Total (quarters 2-13) 


97.3 


97.6 


-0.3 


-0.3% 


Average number of months receiving 










AFDC payments 










Year 1 (quarters 2-5) 


10.58 


10.89 


—0.31 


—2.8% 


Year 2 (quarters 6-9) 


9.14 


9.55 


—0.41 *** 


—4.3% 


Year 3 (quarters 10-13) 


7.95 


8.30 


—0.35 ** 


—4.2% 


Total (quarters 2-13) 


27.67 


28.74 


— 1 .0/ 


—3.7% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


96.2 


96.3 


—0.1 


—0.1% 


Quarter 2 


95.7 


95.5 


0.2 


0.2% 


Quarter 3 


91 .8 


94.6 




—3.0% 


Quarter 4 


88.9 


91 .6 


-2.7 *** 


—3.0% 


Quarter 5 


84.8 


87.9 


—3.1 *** 


—3.6% 


Quarter 6 


81 .8 


85.7 


—3.9 *** 


—4.5% 


Quarter 7 


79.0 


82.5 


— 


A 00/ 


Quarter 8 


/ D.O 


/ y.D 


OR* 


Q 00/ 

— O.O /o 


Quarter 9 


74.0 


76.3 


-2.3 


-3.0% 


Quarter 10 


71.5 . 


74.0 


-2.5 * 


-3.4% 


Quarter 1 1 


69.5 


71.2 


-1.6 


-2.3% 


Quarter 1 2 


66.7 


69.7 


-3.0 ** 


-4.3% 


Quarter 13 


63.8 


67.5 


-3.7 ** 


-5.5% 


Quarter 14 


61.7 


65.0 


-3.3 ** 


-5.1% 


Quarter 1 5 


59.6 


62.9 


-3.3 ** 


-5.2% 


Quarter 16 











Average total AFDC payments received ($) 

Year 1 (quarters 2-5) 6874 7202 -328 *** -4.5% 

Year 2 (quarters 6-9) 571 1 6111 -401 *** -6.6% 

Year 3 (quarters 10-13) 4729 5006 -277 ** -5.5% 

Total (quarters 2-13) 17314 18319 -1005 *** -5.5% 



Average AFDC payments received ($) 



Quarter of random assignment 


1917 


1922 


-5 


-0.3% 


Quarter 2 


1861 


1901 


-.40 *** 


-2.1% 


Quarter 3 


1752 


1855 


-103 *** 


-5.6% 


Quarter 4 


1673 


1765 


-91 *** 


-5.2% 


Quarter 5 


1588 


1681 


-93 *** 


-5.5% 


Quarter 6 


1525 


1638 


-112 *** 


-6.9% 


Quarter 7 


1461 


1557 


-107 *^* 


-6.8% 


Quarter 8 


1398 


1498 


-100 *** 


-6.7% 


Quarter 9 


1327 


1408 


-81 *** 


-5.8% 


Quarter 10 


1261 


1332 


-71 ** 


-5.3% 


Quarter 1 1 


1225 


1287 


-62 ** 


-4.8% 


Quarter 1 2 


1161 


1236 


-75 *** 


-6.1% 


Quarter 13 


1082 


1151 


-69 ** 


-6.0% 


Quarter 14 


1019 


1085 


-66 ** 


-6.1% 


Quarter 15 


973 


1038 


-65 ** 


-6.3% 


Quarter 16 










Sample size (total = 4396) 


2995 


1401 







SOURCE AND NOTES: See Table 4.1. Fourteen quarters of employment and earnings follow-up data and 15 quarters 
of AFDC data are available for Los Angeles. 
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TABLE D.5 



RIVERSIDE AFDC-FGs: IMPACTS ON EMPLOYMENT. EARNINGS. 
AFDC RECEIPT, AND AFDC PAYMENTS 



Outcome and Follow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Year 1 (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-1 3) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quart'ar 1 3 
Quarter 14 
Quarter 15 



52.1 
49.4 
44.5 
67.1 



1.34 
1.42 
1.31 
4.07 



21.6 
31.2 
33.4 
34.3 
35.3 
35.4 
35.5 
35.5 
35.3 
34.3 
33.5 
32.0 
31.2 
31.7 



34.0 
35.4 
35.2 
53.4 



0.84 
0.97 
0.98 
2.78 



16.7 
19.1 
20.4 
22.0 
22.1 
22.6 
25.3 
24.8 
24.0 
24.5 
24.8 
24.2 
24.6 
24.3 



18.0 *** 
14.0 *** 
9.3 *** 
13.6 *** 



0.51 *** 
0.45 *** 
0.33 *** 
1 .28 *** 



^ g *** 

12.1 *** 
13.0 *** 
12.3 *** 
13.3 *** 
12.7 *** 

10.2 *** 
10.7 *** 

1 1 .3 *** 
9.8 *** 

8.7 *** 

7.8 *** 
6.6 *** 
7.5 *** 



53.0% 
39.6% 
26.3% 
25.5% 



60.6% 
46.4% 
33.5% 
46.1% 



29.1% 
63.1% 
63.9% 
55.8% 
60.2% 
56.2% 
40.3% 
43.2% 
47.0% 
39.9% 
35.1% 
32.2% 
26.7% 
30.8% 



Quarter 1 6 










Average total earnings ($) 










Year 1 (quarters 2-5) 


2470 


1550 


920 *** 


59.3% 


Year 2 (quarters 6-9) 


3416 


2233 


1183 *** 


53.0% 


Year 3 (quarters 10-13) 


3562 


2552 


1010 *** 


39.6% 


Total (quarters 2-13) 


9448 


6335 


3113 *** 


49.1% 


Average total earnings ($) 










Quarter of random assignment 


230 


168 


62 *** 


37.1% 


Quarter 2 


453 


259 


198 *** 


76.4% 


Quarter 3 


603 


381 


222 *** 


58.2% 


Quarter 4 


671 


443 


228 *** 


51.5% 


Quarter 5 


738 


466 


271 *** 


58.2% 


Quarter 6 


808 


497 


311 *** 


62.5% 


Quarter 7 


845 


580 


265 *** 


45.6% 


Quarter 8 


876 


591 


285 *** 


48.2% 


Quarter 9 


887 


565 


322 *** 


57.0% 


Quarter 10 


896 


605 


291 *** 


48.1% 


Quarter 1 1 


885 


617 


268 *** 


43.4% 


Quarter 1 2 


898 


660 


238 *** 


36.1% 


Quarter 1 3 


884 


671 


213 *** 


31.8% 


Quarter 14 


917 


650 


266 *** 


40.9% 


Quarter 1 5 










Quarter 16 
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TABLE D,5 (continued) 



OiitonmpanH Fnllnw— IJn Pprinri 


Fy Deri mentals 


Controls 


Difference 


Percentage 
Change 


CVcf received aliy r\rU\^ [JayiTitsiUo \/o} 










Teal 1 ^CjUailcrS ^~-0) 


on ft 


Qn ft 


0.1 


0.1% 


Tear ^ ^c]Uaners D~^yy 


7 


.t 


_5 -J *** 


—8.7% 


Year 3 (quarters 10-13) 


49.8 


54.7 


—4 9 *** 


-8.9% 


Total (quarters 2-13) 


91.8 


91.9 


-0.1 


-0.1% 


MveraQv numuer oi monins receiving 










AFDC '^yments 










Year i ^quaners o; 


O.UD 


A 7n 


— n RR *** 


—7 S% 


Year^ ^quarieis o— 


D.OO 


K ill 


— n 79 *** 


— 11 .3% 


Year o ^quaners lU— loj 




RR 


— n 7*^ *** 


— 1 Q 9% 


lotai ^quarrers ^— lo; 








— 10 9% 


tver receiveo any Aruo paymenis ^/oj 










Quarter of random assignment 






— n R 


—0.7% 


Quarter 2 


AQ A 


AO 9 




0.3% 


vjuarter o 


7R A 


7Q R 


—3.9 *** 


—4.8% 


Quarter 4 


DO.U 


70 R 




^ . 1 /o 


Quarter 5 


RA 7 
DO. f 


RR Q 


-7 0 *** 

/ 


1 \ .\J /o 


Quarter 6 


RA R 


R1 1 




— 1 n fi% 

1 v.O /O 


Quarter 7 




57.0 


-5.3 *** 


—9.3% 


tartor A 
VjfUCll Id O 


49.1 


55.1 


-6.1 *** 


-11.0% 


Quarter 9 


46.6 


52.0 


-5.4 *** 


-10.3% 


Quarter 10 


45.0 


50.4 


-5.4 *** 


-10.7% 


Quarter 1 1 


43.1 


49.6 


-6.5 *** 


-13.1% 


Quarter 12 


41.7 


47.5 


-5.8 *** 


-12.2% 


Quarter 13 


40.6 


45.6 


-5.2 *** 


-1 1 .4% 


Quarter 14 


38.9 


44.0 


-5.1 *** 


-11.6% 


Quarter 1 5 


37.2 


42.2 


-5.0 *** 


-11.8% 


Quarter 1 6 











Average total AFDC payments received ($) 

Year 1 (quarters 2-5) 4962 5658 -695 *** -12.3% 

Year 2 (quarters 6-9) 3458 4161 -703 *** -16.9% 

Year 3 (quarters 10-13) 2864 3448 -584 *** -16.9% 

Total (quarters 2-13) 1 1 284 1 3267 -1983 *** -1 4.9% 



Average AFDC payments received ($) 



Quarter of random assignment 


1667 


1668 


-1 


-0.0% 


Quarter 2 


1598 


1683 


-85 *** 


-5.0% 


Quarter 3 


1261 


1441 


-181 *** 


-12.5% 


Quarter 4 


1105 


1327 


-222 *** 


-16.7% 


Quarter 5 


998 


1206 


-207 *** 


-17.2% 


Quarter 6 


932 


1133 


-201 *** 


-17.7% 


Quarter 7 


891 


1060 


-168 *** 


-15.9% 


Quarter 8 


841 


1008 


-167 *** 


-16.6% 


Quarter 9 


793 


960 


-167 *** 


-17.4% 


Quarter 10 


758 


922 


-165 *** 


-17.8% 


Quarter 1 1 


736 


895 


-158 *** 


-17.7% 


Quarter 1 2 


703 


838 


-135 *** 


-16.1% 


Quarter 13 


667 


793 


-126 *** 


-15.9% 


Quarter 14 


637 


758 


-121 *** 


-15.9% 


Quarter 1 5 


602 


716 


-113 *** 


-15.8% 


Quarter 1 6 










Sample size (total = 5508) 


4457 


1051 







SOURCE AND NOTES: See Table 4.1 . Fourteen quarters of employment and earnings follow-up data and 1 5 quarters 
of AFDC data are available for Riverside. 
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TABLE D.6 



SAN DIEGO AFDC-FGs: IMPACTS ON EMPLOYMENT, EARNINGS, 
AFDC RECEIPT, AND AFDC PAYMENTS 











Percentage 


Outcome and Follow— Up Period 


Experimental 


Controls 


Difference 


Change 


Ever employed (%) 










Year 1 (quarters 2-5) 


46.0 


40.0 


6.0 *** 


14.9% 


Year 2 (quarters 6—9) 


AC SI 


hU.o 


D.I 


^ D AO/ 


Year 3 (q uarters 10 — 13) 


42.5 


37.3 


b.2 


13.9% 


Total (quarters 2-13) 


62.2 


56.5 


5.7 *** 


10.0% 


Average number of quarters with 










employment 










Year 1 (q ua rte rs 2 - 5) 


1.22 


1 .04 


0.18 


17.2% 


Year 2 (quarters 6-9) 


1 .32 


1 .1 2 


0.20 *** 


18.2% 


Year 3 (quarters 10-13) 


1.28 


1 .10 


0.18 *** 


16.2% 


Total (quarters 2-13) 


3.81 


3.25 


0.56 *** 


17.2% 


Ever employed (%) 










Quarter of random assignment 


24.1 


23.2 


0.9 


3.7% 


Quarter 2 


26.3 


23.3 


3.0 ** 


12.8% 


Quarter 3 


30.0 


25.9 


^ 2 AAA 


16.2% 


Quarter 4 


32.2 


27.0 


5.2 *** 


19.2% 


Quarter 5 


33.1 


27.6 


C c ititit 

5.5 


19.9% 


Quarter 6 


33.3 


28.6 


4.8 *** 


16.7% 


Quarter 7 


00.2 


28.4 


A C *** 




Quarter 8 


33.0 


28.2 


^ ^ AAA 


16.7% 


Quarter 9 


32.5 


26.4 


a r\ it** 


22.7% 


Quarter 10 


32.5 


26.8 


C "7 *** 


OH HO/ 


Quarter 1 1 


31.9 


28.0 


3.9 *** 


13.7% 


Quarter 1 2 


31.5 


26.9 


4.6 *** 


16.9% 


Quarter 1 3 


O 1 .f 




Q 7 A** 


1 'X AO/ 
I <J.*\ /o 


Quarter 1 4 


31 .5 


28.6 


o n itit 
2.9 


1 0.»3% 


Quarter 1 5 


31 .3 


28.8 


r% A it 
2.4 


8.5% 


Quarter 1 6 


31.1 


28.4 


O "7 * 

2.7 


9.6% 


Average total earnings ($) 










Year 1 (quarters 2— 5) 


2462 


2113 


349 


16.5% 


Year 2 (quarters 6—9) 


3503 


2794 


~7r\r\ ititik 

709 


OC AO/ 

2b. 4% 


Year 3 (quarters 10 — 13) 


3821 


3108 


"7^0 A** 


23.0% 


Total (quarters 2-13) 


9786 


8014 


4 -7-7 rt ititit 

1772 


22.1% 


Average total earnings ($) 










Quarter of random assignment 


272 


231 


>* ^ A* 


H 7 QO/ 
I / .OTO 


Quarter 2 


432 


349 




OO CO/ 


Quarter 3 


582 


494 


OO itit 

oo 


A "7 70/ 

I ( J /o 


Quarter 4 


693 


593 


'4 A* 
101 


H 7 /^O/ 

I I Sj /o 


Quarter 5 


fob 


OtO 


"7Q A 

. O 


i i AO/ 

1 1 .D7o 


Quarter 6 


836 


691 


145 *** 


21.1% 


Quarter 7 


869 


685 


183 *** 


26.7% 


Quarter 8 


888 


699 


189 *** 


27.0% 


Quarter 9 


910 


718 


192 *** 


26.7% 


Quarter 10 


942 


745 


198 *** 


26.5% 


Quarter 1 1 


944 


742 


202 *** 


27.3% 


Quarter 1 2 


965 


768 


197 *** 


25.6% 


Quarter 1 3 


969 


853 


117 * 


13.7% 


Quarter 14 


1015 


896 


119 * 


13.3% 


Quarter 1 5 


1018 


892 


126 ** 


14.1% 


Quarter 16 


1028 


895 


133 ** 


14.9% 


(continued) 
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TABLE D.6 (continued) 



Outcome and Folbw-Up Period 



Bxperimentals 



Controls 



Difference 



Percentage 
Change 



Ever received any AFDC payments (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Years (quarters 10-13) 
Total (quarters 2-13) 



94.8 
68.2 
57.4 
95.6 



95.3 
71.5 
61.2 
95.9 



-0.5 
-3.2 
-3.7 
-0.4 



** 



-0.6% 
-4.5% 
-6.1% 
-0.4% 



AFDC payments 






-0.37 *** 


-3.9% 


Year 1 (quarters 2-5) 


9.11 


9.48 


Year 2 (quarters 6-9) 


6.84 


7.44 


-0.60 *** 


-8.1% 


Years (quarters 10-13) 


5.93 


6.36 


-0.43 ** 


-6.7% 


Total (quarters 2-13) 


21.88 


23.29 


-1.40 *** 


-6.0% 


Ever received any AFDC payments (%) 








—0.0% 


Quarter of random assignment 


98.4 


98.4 


-0.0 


Quarter 2 


94.1 


94.7 


-0.6 


-0.7% 


Quarter 3 


83.3 


85.6 


-2.2 * 


-2.6% 


Ouartpr 4 


74.8 


77.9 


-3.0 ** 


-3.9% 


Quarter 5 


69.1 


72.1 


-3.1 ** 


-4.2% 


Quarter 6 


63.9 


67.5 


-3.6 ** 


-5.4% 


Quarter 7 


60.3 


65.7 


—5.3 *** 


-8.1% 


Quarter 8 


58.3 


63.7 


-5.4 *** 


-8.5% 


Quarter 9 


56.0 


61.1 


-5.1 ** 


-8.3% 


Quarter 10 


53.8 


58.0 


—4.2 *** 


-7.2% 


Quarter 1 1 


52.2 


55.6 


-3.4 ** 


-6.1% 


Quarter 1 2 


50.5 


53.8 


-3.4 ** 


-6.3% 


Quarter 1 3 


49.0 


51 .9 


-3.0 * 


-5.7% 


Quarter 14 


47.0 


49.2 


-2.2 


-4.5% 


Quarter 15 


45.5 


47.7 


-2.2 


-4.6% 


Quarter 16 


43.9 


45.6 


-1.7 


-3.7% 


Average total AFDC payments received ($) 










Yearl (quarters 2-5) 


5529 


5832 


-302 *** 


-5.2% 


Year 2 (quarters 6-9) 


4199 


4679 


-480 *** 


-10.3% 


Year 3 (quarters 10-13) 


3555 


3908 


-353 *** 


-9.0% 


Total (quarters 2-13) 


13283 


14419 


-1136 *** 


-7.9% 


Average AFDC payments received ($) 








A r\o/ 
— 1 XJr/Q 


Quarter of random assignment 


1584 


1600 




Quarter 2 


1606 


1652 


-46 ** 


-2.8% 


Quarter 3 


1416 


1490 


*** 


-5.0% 


Quarter 4 


1300 


1396 


—97 *** 


. -6.9% 


Quarter 5 


1207 


1293 


-86 *** 


-6.7% 


Quarter 6 


1126 


1226 


-100 *** 


-8.2% 


Quarter 7 


1063 


1186 


-124 *** 


-10.4% 


Quarter 8 


1025 


1154 


-128 *** 


-11.1% 


Quarter 9 


985 


1113 


-128 *** 


-11.5% 


Quarter 10 


946 


1051 


-105 *** 


-10.0% 


Quarter 1 1 


909 


1005 


-96 *** 


-9.6% 


Quarter 12 


869 


956 


-86 *** 


-9.0% 


Quarter 13 


830 


896 


-66 ** 


-7.4% 


Quarter 14 


791 


642 


-52 * 


-6.1% 


Quart'jr 15 


755 


806 


-51 * 


-6.3% 


Quarter 16 


715 


769 


-54 ** 


-7.0% 


Sample size (total =8219) 


7049 


1170 






SOURCE AND NOTES: See Table 4.1 . Sixteen quarters of follow- 


up data are available for San Diego. 
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TABLE D.7 



TULARE AFDC-FGs: IMPACTS ON EMPLOYMENT. EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Foltow-Up Period 



Experlmentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Year 1 (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 
Quarter 16 



39.9 
41.8 
43.9 
59.5 



1.00 
1.15 
1.26 
3.41 



19.8 
22.8 
24.8 
25.7 
27.0 
29.2 
28.4 
28.6 
28.5 
31.2 
307 
32.4 
31.4 



40.9 
42.3 
38.0 
55.3 



1.04 
1.14 
1.07 
3.25 



21 7 
23.6 
25.8 
27.5 
27.0 
28.0 
30.7 
29.5 
25.5 
27.1 
27.1 
26.5 
26.6 



-1.0 

-0.5 
5.8 *** 
4.2 ** 



-0.04 
0.01 
0.18 ** 
0.16 



-2.0 
-0.8 
-1.0 
-1.8 
-0.1 
1.2 
-2.3 
-0.9 
3.0 
4.1 
3.5 
5.9 
4.8 



-2.4% 
-1.2% 
15.3% 
7.6% 



-3.5% 
0.9% 

17.0% 
4.8% 



-9.1% 
-3.6% 
-3.8% 
-6.4% 
-0.2% 
4.3% 
-7.5% 
-3.1% 
1 1 .7% 
15.2% 
13.0% 
22.2% 
17.9% 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10 --13) 
Total (quarters 2-13) 

Average total earnings ($) 



1792 
2536 
3111 
7439 



1941 
2531 
2594 
7066 



-149 
5 

518 ** 
374 



Quarter of random assignment 




220 


240 


-20 


Quarter 2 




327 


329 


-2 


Quarter 3 




435 


431 


4 


Quarter 4 




512 


575 


-63 


Quarter 5 




519 


606 


-88 


Quarter 6 




619 


623 


-3 


Quarter 7 




632 


630 


2 


Quarter 8 




629 


672 


-42 


Quarter 9 




655 


606 


48 


Quarter 10 




754 


660 


94 


Quarter 1 1 




769 


657 


112 


Quarter 12 




789 


664 


125 


Quarter 13 




799 


612 


187 


Quarter 14 










Quarter 15 










Quarter 16 











-7.7% 
0.2% 

20.0% 
5.3% 



-8.2% 
-0.6% 
0.9% 
-11.0% 
--14.5% 
-G.5% 
0.3% 
-6.3% 
8.0% 
14.2% 
17.1% 
18.8% 
30.5% 



(continued) 
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TABLE D.7 (continued) 



Percentage 



Outcome and Follow-Up Period 


Experimentals 


Controls 


Difference 


Change 


Ever received any AFDC payments (%) 










Year 1 (quarters 2-5) 


95.5 


94.5 


1.1 


1.1% 


Year 2 (quarters 6—9) 


75.7 


75.0 


0.7 


0.9% 


Years (quarters 10-13) 


65.6 


63.9 


1.7 


2.6% 


Total (quarters 2-13) 


95.9 


94.7 


1.3 


1.3% 


Average number of months receiving 










AFDC payments 










Year 1 (quarters 2-5) 


9.72 


9.59 


0.13 


1.3% 


Year 2 (quarters 6-9) 


7.84 


7.70 


0.14 


1 .8% 


Year 3 (quarters 10-13) 


6.67 


6.83 


-0.16 


-2.3% 


Total (quarters 2-13) 


24.24 


24.13 


0.11 


0.5% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


96.4 


95.3 


1.2 


1.2% 


Quarter 2 


94.3 


93.6 


0.6 


0.7% 


Quarter 3 


87.0 


86.7 


0.3 


0.4% 


Quarter 4 


81.0 


81.0 


-0.0 


-0.0% 


Quarter 5 


76.7 


75.0 


1.7 


2.3% 


Quarter 6 


72.3 


71.6 


0.7 


1.0% 


Quarter 7 


68.5 


68.7 


-0.2 


-0.4% 


Quarter 8 


66.2 


64.4 


1.8 


2.7% 


Quarter 9 


65.4 


62.2 


3.1 


5.0% 


Quarter 10 


62.5 


61.5 


1.0 


1 .6% 


Quarter 1 1 


59.8 


60.5 


-0.7 


-1.1% 


Quarter 1 2 


56.6 


58.4 


-1.8 


-3.0% 


Quarter 13 


54.5 


56.2 


-1.7 


-3.1% 


Quarter 14 










Quarter 15 










Quarter 16 











Average total AFDC payments received ($) 



Year 1 (quarters 2-5) 


6363 


6231 


132 


2.1% 


Year 2 (quarters 6-9) 


5118 


5023 


95 


1 .9% 


Year 3 (quarters 10-13) 


4171 


4284 


-113 


-2.6% 


Total (quarters 2-13) 


15653 


15538 


114 


0.7% 


Werage AFDC payments received ($) 










Quarter of random assignment 


1669 


1674 


-5 


-0.3% 


Quarter 2 


1757 


1726 


31 


1.8% 


Quarter 3 


1639 


1608 


32 


2.0% 


Quarter 4 


1521 


1505 


15 


1 .0% 


Quarter 5 


1446 


1392 


53 


3.8% 


Quarter 6 


1369 


1323 


45 


3.4% 


Quarter 7 


1291 


1298 


-7 


-0.5% 


Quarter 8 


1249 


1213 


36 


2.9% 


Quarter 9 


1210 


1188 


21 


1 .8% 


Quarter 10 


1147 


1153 


-6 


-0.5% 


Quarter 1 1 


1071 


1109 


-38 


-3.5% 


Quarter 12 


1003 


1034 


-31 


-3.0% 


Quarter 13 


950 


988 


-37 


-3.8% 


Quarter 14 










Quarter 15 










Quarter 16 











Sample size (total = 2234) ] 15_88 646 



SOURCE AND NOTES: See Table 4.1 . Thirteen quarters of follow-up data are available for Tulare. 
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APPENDIX E 



AFDC CASE CLOSURE AND RECIDIVISM 



This appendix presents the results of an analysis of AFDC case closure and recidivism in the 
GAIN research sample. In part, this analysis was prompted by a single question: Would a strong 
program focus on getting enrollees quickly into jobs and off welfare merely lead to a high rate of 
return to welfare later on? This question is important because that kind of AFDC recidivism could 
cancel out the impacts of the initial case closures. The question was raised particularly with reference 
to the GAIN program in Riverside, which was seer to be a premier example of a quick employment 
focus. 

For AFDC-FGs, the analysis found that recidivism did, in some counties, tend to offset the 
increase in case closures produced by GAIN, but the offset was only partial and fairly modest. This 
was true even in Riverside, where the effect wa^ largest.^ For AFDC-Us, the effect of recidivism 
was more serious. Returns to welfare by the end of the three-year follow-up period offset most of the 
increase in case closures initially achieved for AFDC-Us by GAIN in Riverside and San Diego. Re- 
cidivism had much less effect among AFDC-Us in Butte, which explains why impacts on AFDC 
payments in that county in year 3 had overtaken and surpassed those of Riverside and San Diego. 



L Results for AFDC-FGs 

One of the principal ways that welfare-to-work programs reduce AFDC payments is by inducing 
people to leave welfare. Case closures can produce AFDC savings (i.e., lead to lower AFDC 
payments for experimentals than for controls on average) if (a) those experimentals who leave AFDC 
do so sooner than comparable controls and (b) those experimentals who leave do not return to AFDC 
quickly. The latter behavior - namely, rapid return to AFDC ~ is known as AFDC recidivism. This 
appendix examines the effects of GAIN on AFDC case closure and recidivism, focusing on two key 
questions: First, are larger AFDC savings across counties associated with faster AFDC case closure? 
Second, has AFDC recidivism caused GAIN'S impacts on AFDC payments to shrink over time? 

To summarize the results, GAIN increased AFDC case closure during the first half of the three- 
year follow-up period in Los Angeles, Riverside, and San Diego. Most of these increases were for 
sample members who got off AFDC and stayed off through the end of the follow-up. These effects 
were largest in Riverside but noteworthy in the other two counties as well. Recidivism also increased; 
however, returns to welfare occurred for only a minority of the people who left welfare and Jius only 
partially offset the effect of faster case closures in producing overall impacts on AFDC payments, even 
in Riverside. 

This analysis employs a particular approach to recidivism that makes use of the experimental 
design in order to obtain unbiased estimates of the effects of GAIN; it restricts its focus to the three- 
year observation period and does not project recidivism beyond the end of year 3. The advantage in 



^Recidivism therefore did not detract from the overall accomplisliments of GAIN for AFDC-FGs in 
Riverside or the other counties. 
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not attempting projections is that the conclusions will be based entirely on actual, observed behavior 
rather than on assumptions about how people will behave in future years. The disadvantage is that, 
for many sample members, only a portion of their time on or off AFDC will be observed.*^ 

The analysis defines an "AFDC exit" as one full quarter of zero AFDC payments. It therefore 
does not capture any "revolving door" effects or "churning" due to administrative actions. It should 
also be noted that the measures used in this analysis make it possible to distinguish recidivism that lasts 
only a short time from tliat which may last a long time. 

Considerable care must be taken when interpreting estimates of recidivism. Return to AFDC 
does not necessarily imply a failure of the program. Whenever cases are closed in the experimental 
group, recidivism should be expected to occur for some of those cases, just as it occurs for cases that 
are closed in the control group. An extended illustration may be helpful in clarifying the issue. To 
begin, suppose that 50 percent of controls exit AFDC during the first half of the follow-up period 
(quarters 2 through 7), and 20 percent of exiters in the control group are back on AFDC by the end 
of the follow-up period (by quarter 13), This 20 percent is the probability of returning to welfare 
among control exiters and is one measure of recidivism; it is called conditional recidivism because the 
probability is conditional on exiting AFDC initially. In this example, it will also be the case that 10 
percent (i.e, , 0,50 x 0,20) of all controls exit and then return, which is a second measure of recidivism 
called unconditional because the percentage is not based on the condition of having exited AFDC 
initially, but, rather, is based on the entire control group. 

To develop the example further, suppose next that 60 percent of experimentals exit during the 
same period, for an impact of 10 percentage points on case closure (i.e., 60 p-ercent of experimentals 
minus 50 percent of controls). Now, assume that exiters in the experimental group have only an 18 
percent chance of returning to AFDC, This measure, the probability of rewming to welfare among 
experimental exiters, indicates that conditional recidivism among experimentals (18 percent) is less than 
it is among controls (20 percent). This corriparison between experimentals and controls who exit 
AFDC is not, however, a true experimental comparison, since the probabilities exclude sample 
members who do not exit. Such comparison may, therefore, yield biased inferences about the effects 
of the program. For example, the conditional probability of recidivism may be lower for exiters in 
the experimental group because the program obtained more case closures for sample members who 
would not be likely to return to welfare anj'way. That is, the program changed the kinds of people 
who exited AFDC, not the probability that vhey would return to it. 

In this hypothetical illustration, using the second measure reveals an unconditional recidivism 
rate of 10.8 percent among all experimentals (0,60 x 0.18), compared to only 10 percent among all 
controls. This is a true experimental comparison, yielding an unbiased, valid estimate of the effect 
jf the program. Judging by this second measure, however, the rate of recidivism is higher among ex- 



^Some sample members who exit AFDC during the observation period will return only after the three 
years have elapsed. Thus, this analysis will put them in the "permanent AFDC case closure" category when 
they ought to be classified as recidivists. But only longer follow-up data would make it possible to identify 
the long-term recidivists with certainty. In this connection, it should also be noted that sample members who 
left AFDC in one county and returned to it in another county (or in another state) will appear in the data as 
permanent case closures rather than as recidivists because tiieir AFDC payments in their new jurisdiction are 
not part of the i csearch data set. 
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perimentals than among controls. That is, the program in this example increased the proportion of 
experimentals who left AFDC and then returned. This result is misleading, however, since the 
program decreased the probability of returning to AFDC among those who exited, and also increased 
the probability of leaving welfare in the first place. 

In this illustration, the second measure of recidivism yields a valid experimental estimate of 
program's effect but is misleading about what the program achieved. The program produced AFDC 
savings despite the fact that it also increased the proportion of experimentals who both left welfare and 
returned. AFDC savings would clearly be larger if no one in the experimental group who exited 
AFDC later returned, but the fact that some did does not necessarily indicate that the program was 
unsuccessful in achieving welfare savings, for it increased the likelihood of case closure overall. One 
way to avoid such errors of interpretation is to make judicious use of both kinds of recidivism 
measures. 

Table E.l presents case closure and recidivism estimates for AFDC-FGs by county. 
Unconditional estimates are shown on the left. Conditional estimates are shown on the right. The 
largest effects were found in Riverside. As shown on the left of the table, 47.7 percent of Riverside 
controls exited AFDC before the middle of follow-up. Among experimentals, this figure was 55.4 
percent, for an impact of 7.7 percentage points on initial case closures (statistically significant). The 
next several rows of the table divide this impact on initial exits into four parts. The largest part is a 
4.0 percentage point increase in the number of experimentals exiting AFDC without returning during 
the remainder of the three-year observation period. These are individuals who got off AFDC and 
stayed off. The effect is statistically significant and is the largest among the six counties. This 
increase in permanent AFDC case closures - "permanent" given the three-year limit on follow-up 
data — explains Riverside's hrge total impact on AFDC payments. There was also a small increase, 
0,9 percentage points, in the aumber of experimentals exiting AFDC, then returning, and then leaving 
again. This off-on-off behavior made little contribution to the total impact in Riverside because it does 
not suggest a return to welfare that lasted any substantial length of time. 

The third and fourth parts of the exit effect represent patterns of behavior that are more 
consequential for AFDC savings. The third part of the exit effect is an increase of 1.2 percentage 
points (statistically significant) among experimentals in leaving AFDC and being back on at the end 
of follow-up in year 3 but not for the whole third year. The fourth part of the overall effect is a 1.6 
percentage point increase among experimentals in exiting AFDC and returning for all of the final 
follow-up year (i.e, receiving some AFDC in each of the four quarters of year 3). Welfare receipt 
for all four quarters suggests that receipt may continue for a long time afterwards. Tlie increase in 
this fourth measure therefore suggests that some experimentals who exited AFDC returned for what 
could be fairly long stays. The effect is statistically significant and amounts to about one-fifth of the 
total 7.7 percentage point impact on the proportion of experimentals who ever left AFDC during the 
first half of the follow-up period. Effects on measures three and four together account for about one- 
third of the 7.7 percentage point impact. 

It should also be noted that the probability of returning to AFDC was larger among exiting ex- 
perimentals than among exiting controls, as shown on the right of the table. This higher probability 
of return to welfare among exiters slightly offset the impact on initial AFDC exits. Two simple "what 
if" scenarios can demonstrate the relative importance of recidivism in general and of the higher 
conditional probability of return among experimentals. First, had none of the exiting experimentals 
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or controls returned to AFDC, the 5.2 percentage point impact on AFDC receipt for quarter 13 in 
Riverside (see Table 4.1) would have been larger by the 1.2 plus 1.6 percentage points attributed to 
recidivism. That is, if the patterns of recidivism reflected in the third and fourth parts of the exit 
effect (discussed above) did not exist in either research group, then the impact would have been 8.0 
percentage points rather than 5.2 percentage points, an increment of about half. Thus, the existence 
of recidivism clearly is a factor in determining the magnitude of AFDC impacts. But the existence 
of recidivism cannot be assumed away, which leads to the second "what if" scenario, in which the 
existence of recidivism is allowed for, and the task is to determine only the effect of the difference in 
recidivism between experimentals and controls. The results show that had the probability of returning 
to welfare among exiting experimentals been kept as low as among exiting controls, then the 5.2 per- 
centage point impact on AFDC in quarter 13 would have been about 6.9 percentage points, or about 
one-third higher.-^ 

Taken together, these results indicate that Riverside substantially speeded up the rate of case 
closure, increasing the number of experimentals exiting AFDC in the first half of follow-up. The 
majority of those who exited did not return within the three-year follow-up period, thereby contributing 
to the large AFDC savings observed in that county. A significant proportion did return, however. 
And the probability of returning to welfare among those who exited appeared to be higher for experi- 
mentals than controls. Total AFDC impacts would have been larger - but not dramatically larger ~ 
if the program had been able to keep the probability of returning to welfare the same among exiting 
experimentals as among exiting controls. 

Impacts on AF^C exits within the first year and a half were also found in Los Angeles and San 
Diego. Next to Riverside, San Diego had the largest case closure effects. There was a 5.3 percentage 
point increase among experimentals in initial exits (statistically significant). About four-fifths of that 
was an increase in either permanent exits (3.1 percentage points) or exits with only a brief return 
period before a subsequent exit (1.1 percentage points). Los Angeles had a 4.1 percentage point 
impact on initial exits (statistically significant), and four-fifths of that also accrued to permanent exits 
(3,0 percentage points) or off-on-off exits (0.3 percentage points). For both Los Angeles and San 
Diego, recidivism effects on exiting and then returning to welfare for all or part of the final year were 
small and did not offset the case closure effect by much. It should be noted that if the two recidivism 
measures are combined, then Los Angeles and San Diego (unlike Riverside) show similar probabilities 
of return to AFDC among exiting experimentals and controls. 

Alameda and Butte did not have noteworthy impacts on initial AFDC case closures, at least not 
as measured here. Recidivism effects were not evident in Alameda. In Butte, experimental-control 
differences in being back on AFDC at the end of year 3 and for all of year 3 largely canceled each 
other out. The impacts on total AFDC payments estimated for those two counties (see Table 4. 1) must 
have come from other effects not shown in Table E.l. For Butte, as mentioned in Chapter 4, much 
less of the total AFDC savings came from reduced months on AFDC than was true for the other 
counties with AFDC savings. What the mechanism of AFDC impacts in Alameda might be is not 
clear. 



^This estimate is obtained by assuming that the probability of returning to welfare among exiting 
experimentals for both recidivism measures is the same as for exiting controls. The impact on the two 
combined recidivism measures would then have been 55.4 x (2.6 -f 4.5) / 47.7 - (2.6 -f 4.5) = 1.1 
percentage points. That would be 1 .7 percentage points lower than the 2.8 percentage point combined effect 
observed. Adding 1.7 to 5.2 yields the 6.9 percentage point effect mentioned in the text. 
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IL Results for AFDC-Us 



Table E.2 presents AFDC case closure and recidivism results for AFDC~Us. To sunmiarize 
the findings: These results indicate that faster AFDC case closures contributed to total impacts on 
AFDC receipt and AFDC payments in Butte, Riverside, and San Diego. Recidivism played a more 
prominent role in determining total welfare impacts among AFDC-Us- than among AFDC-FGs. In 
Riverside and San Diego, most of the initial effect on exits was offset by recidivism prior to the end 
of the three-year follow-up. Recidivism had much less effect in Butte, which explains why AFDC 
impacts in that county in year 3 had overtaken and surpassed those of Riverside and San Diego. (It 
should be noted that the very small sample size in Alameda made the results for AFDC-Us in that 
county much more uncertain than the results in other counties.) 

As shown in the table, AFDC exits during the first half of follow-up increased in Riverside from 
61.0 percent among controls to 66.6 percent among experimentals, a 5.6 percentage point impact (sta- 
tistically significant). Part of this effect was associated with being off AFDC at the end of the follow- 
up period. But 3.8 percentage points, or two-thirds of the total exit effect, went to an increase in the 
number of experimentals back on AFDC at quarter 13. Most of this, some 2.8 percentage points, was 
for individuals who returned for quarter 13 but not for all of year 3. The remaining 1.0 percentage 
po.'its was for individuals who returned to receive some AFDC in every quarter of the third year. 

The conditional probability of returning to AFDC by the end of the third year was larger among 
exiting experimental?, than among exiting controls (right panel of the table). Both the amount of recidi- 
vism and the higher probability of return for exiting experimentals contributed to the narrowing of 
AFDC reductions over time in Riverside. As shown in the main text (in Table 6.1), the impact on 
the percentage receiving AFDC at the end of year 1 for Riverside was the largest among the counties 
for AFDC-Us; but by the end of year 3 there was no experimental-control difference remaining. If 
recidivism could have been reduced, then the differential could have lasted longer. This would be true 
even if the probability of returning to AFDC were reduced only to the level observed among exiting 
control group members. Just increasing the number of case closures, without reducing recidivism 
below the levels observed for GAIN experimentals, would have less of an effect on total welfare 
impacts for the AFDC-U research sample, especially in comparison with the AFDC-FG sample. 

GAIN also increased exits for AFDC-Us in San Diego. The increase of 6.0 percentage points 
(statistically significant) was similar in magnitude to the effect in Riverside. As in Riverside, recidi- 
vism was a major offset to those exits. At the end of year 3, recidivism accounted for 1.8 plus 2.7 
percentage points of the initial impact on AFDC exits, or about three-quarters of the initial effect. The 
probability of returning to welfare for the end of year 3 or for all of year 3 was greater for exiting 
AFDC-U experimentals than for exiting controls. As mentioned in Chapter 6 (see Table 6.1), by 
quarter 13 there was virtually no difference in AFDC receipt remaining between experimentals and 
controls in San Diego. Much of the decline in the differential over time must be attributed to recidi- 
vism among GAIN eiuroUees who were induced to exit AFDC during the first year and a half of 
follow-up. Lower recidivism would have increased total AFDC impacts among AFDC-Us in San 
Diego and would have yielded some impact on long-term receipt (i.e., receipt at the end of year 3 and 
beyond). 

Tlie only other important case closure and recidivism effects for AFDC-Us were found in Butte. 
In that county, the result was the opposite of the results found in Riverside and San Diego. The 
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impact on initial case closures was only 3.0 percentage points (not statistically significant), about half 
the magnitude of the effects in Riverside and San Diego. But, in Butte, nearly all of the effect went 
into an increase in permanent case closures (i.e., individuals staying off through quarter 13). Thus, 
although the total AFDC impact was somewhat lower in Butte during the early part of follow-up, 
savings for AFDC-Us by the third year were the largest of any county. In addition, there was a 4.8 
percentage point reduction (not statistically significant) in AFDC receipt in quarter 13 (Table 6.1), 
indicating that the GAIN program in Butte had some effect on long-term receipt. About 1 out of 11 
AFDC-U experimentals who would have been on welfare at quarter 13 in Butte were off the rolls at 
that time. These results for Butte provide additional evidence that recidivism was an important offset 
to AFDC impacts for the AFDC-U assistance category in Riverside and San Diego and that decreased 
recidivism could increase total savings and the incidence of long-term receipt for AFDC-Us. 

Los Angeles did not show an increase in initial exits for AFDC-Us. This finding is consistent 
with the finding in Chapter 6 that AFDC receipt rates were not reduced in that county (see Table 6. 1). 
The sizable impact on AFDC payments for AFDC-Us in Los Angeles evidently came from effects 
other than case closures, but what those effects were is not clear. 

Tulare also did not show an increase in initial AFDC exits, but that county did not have 
reductions in AFDC receipt or AFDC payments either. In Alameda, the AFDC-U sample was too 
small to produce reliable estimates. 
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APPENDIX F 
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TABLE F.I 



GAIN'S IMPACTS ON THE PERCENTAGE OF AFDC-FG REGISTRANTS WHO REPORTED BEING EMPLOYED 
WITHIN TWO TO THREE YEARS AFTER ORIENTATION AND THE PERCENTAGE EVER EMPLOYED 

AT A JOB WITH SELECTED CHARACTERISTICS 



Outcome and 
Research Group 



Alameda 



Los 

Angeles (a) 



Riverside San Diego 



Tulare 



All 

Counties (b) 



Ever employed during the 
follow-up period, self-reported (c) 

Experimentals (%) 

Controls (%) 

Difference 

Ever employed during the follow-up 
period ard most recent job provided 
at least 40 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



33.5 
32.1 
• 1.4 



13.4 
10.4 
3.0 



31.8 



11.2 



70.9 
48.3 
22.7 *** 



33.8 
21.6 
12.3 *** 



64.1 
52.3 
11.8 *** 



30.3 
24.7 
5.5 



55.2 
54.5 
0.7 



30.6 
30.7 
-0.1 



55.9 
46.8 
9.1 (d) 



27.0 
21.9 
5.2 (d) 



Ever employed during the foliow-up 
period and most recent job provided 
less than 20 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



7.2 
9.7 
-2.5 



9.0 



12.8 
9.2 
3.6 



8.7 
11.1 
-2.4 



7.6 
8.0 
-0.4 



9.1 
9.5 

-0.4 (d) 



Ever employed during the follow-up 
period and most recent job provided 
less than 10 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



0.8 
4.7 
-4.0 *** 



1.4 



3.9 
2.9 
1.0 



2.6 
4.6 
-2.0 



3.6 
3.2 
0.4 



2.7 
3.9 
-1.1 (d) 



Ever employed during the folbw-up 
period and only held jobs providing 
more than 30 * .ours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



17.0 
16.4 
0.7 



15.3 



37.8 
27.0 
10.8 *** 



35.1 
28.5 
6.7 



34.5 
33.1 
1.3 



31.1 
26.3 
4.9 (d) 



Ever employed during the folbw-up 
period and held jobs providing less than 
30 hours of work per week and jobs 
providing more than 30 hours of work 
per week 

Experimentals (%) 

Controls (%) 

Difference 



3.5 
2.7 
0.8 



1.4 



17.5 
6.8 

10.7 *** 



11.5 
7.3 
4.2 



6.3 
8.7 
-2.4 



9.7 
6.4 

3.3 (d) 



Ever employed during the follow-up 
period and only held jobs providing 
less than 30 hours of work per week 

Experimentals (%) 

Controls (%) 

Difference 



13.0 
13.0 
0.0 



15.3 



15.7 
14.2 
1.5 



17.6 
16.6 
1.0 



14.4 
12.6 
1.8 



15.2 
14.1 
1.1 (d) 



Ever employed during the follow-up 
period and was "highly satisfied" (e.g.. 
had a score of 7 -1 0 on a 0-1 0 scale) 
with most recent job 

Experimentals (%) 

Controls (%) 

Difference 



21 .4 
17.7 
3.7 



17.9 



40.7 
25.3 
15.4 *** 



37.8 
32.2 
5.5 



33.7 
33.5 
0.2 



33.4 
27.2 
6.2 (d) 



RJC 
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TABLE R1 (continued) 



Outcome and Los All 
Research Group Alameda Angeles (a) Riverside San Diego Tulare Counties (b) 

Ever employed during the follow-up 
period and most recent job paid 
more than $300 per week (e) 

Experimentals (%) 7.8 5.4 13.1 16.9 10.5 12.1 

Controls (%) 4.7 — 10.4 11.6 8.7 8.9 

Difference 3.1 * — 2.8 5:3 ** 1.7 3.2 (d) 

Sample size 

Experimentals 335 223 674 337 356 1925 
Controls 348 ^ 342 336 363 1389 

SOURCE: See Table 5.3. 

NOTES: The follow-up period for the registrant survey ranged from 26 to 37 months, on average, across the five counties where 
the reigstrant survey was conducted. Butte County was not included in the survey. 

Rounding may cause slight discrepancies in calculating averages and differences. 

A two -tailed t-test was applied to the differences between the experimental and control groups In each county. 
Statistical significance levels are Indicated as *** = 1 percent; ** = 5 percent; * = 10 percent 

(a) An analysis of response patterns to the survey in Los Angeles revealed that the earnings and AFDC payments during 
the foltow-up period of controls who responded to the survey differed markedly from those of controls who did not respond to the 
survey. For this reason, no estimates for controls and no impacts are presented in this table for Los Angeles. 

(b) In the all-county averages, the results of each county (excluding Los Angeles) are weighted equally. 

(c) In Alameda, employment rates were substantially underreported on the registrant survey, according to a comparison 
with the "ever employed" rate indicated by automated records data through quarter 9 for the same sample of survey respondents. 
Those records data show that 42 percent of experimentals and 36 percent of controls had been employed, for an Impact of 

6 percentage points. 

(d) Tesis of statistical significance of the experimental -control difference for all counties combined were not performed. 

(e) Most r<5spondents reported gross (i.e., pre-tax) earnings. However, a sizable minority (roughly 20 percent reported 
net (i.e.. post-tax) earnings. No adjustment was made for those reporting post -tax earnings. Therefore, the estimates presented 
in this table somewhat underestimate the percentage of respondents with gross weekly earnings In excess of a given level. 
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TABLE G.1 



ALAMEDA AFDC-Us: IMPACTS ON EMPLOYMENT, EARNINGS, 
AFDC RECEIPT, AND AFDC PAYMENTS 



Outcome and Foik)w~Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 16 



29.8 
27.6 
27.5 
46.6 



0.84 
0.83 
0.80 
2.47 



16.6 
17.9 
20.2 
24.0 
21.6 
20.5 
22.2 
21.3 
19.4 
18.4 
21 .4 
19.6 
20.2 



20.2 
20.4 
16.9 
27.0 



0.63 
0.69 
0.50 
1.82 



14.1 

14.9 

15.8 

16.2 

16.6 

19.0 

18.2 

14.6 

16.7 

13.2 

12.2 

11.8 

12.3 



9.6 * 

7.2 
10.6 * 
19.6 *** 



0.20 
0.15 
0.30 * 
0.65 



2.5 

3.0 

4.4 

7.8 ' 

5.0 

1.4 

4.0 

6.8 

2.7 

5.2 

9.3 

7.8 

7.9 



47.3% 
35.4% 
62.7% 
72.7% 



31.9% 
21 .7% 
60.8% 
35.9% 



17.6% 
19.9% 
28.1% 
48.2% 
30.3% 
7.5% 
21 .9% 
46.5% 
16.1% 
39.1% 
76.2% 
65.9% 
64.1% 



Average total earnings ($) 
Yearl (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 



1115 
1332 
1600 
4047 



1061 
1133 
1072 
3265 



54 
200 
528 
782 



5.1% 
17.6% 
49.3% 
23.9% 



Quarter of random assignment 


170 


Quarter 2 


227 


Quarter 3 


239 


Quarter 4 


295 


Quarter 5 


353 


Quarter 6 


249 


Quarter 7 


378 


Quarter 8 


373 


Quarter 9 


333 


Quarter 10 


344 


Quarter 1 1 


412 


Quarter 12 


451 


Quarter 13 


392 


Quarter 14 




Quarter 15 




Quarter 16 





200 
205 
260 
279 
317 
272 
325 
279 
257 
206 
278 
256 
333 



-31 
22 
-21 
16 
36 
-23 
53 
94 
76 
138 
135 
195 
59 



-15.3% 
11.0% 
-8.1% 
5.8% 
1 1 .5% 
-8.5% 
16.4% 
33.7% 
29.4% 
67.3% 
48.6% 
76.3% 
17.8% 
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TABLE Q.1 (continued) 



Percentage 

Outcome and FoUow-Up Period Experlmentals Controls Difference Change 



Ever received any AFDC payments (%) 



Yean (quarters 2-5) 


99.8 


96.8 


3.0 * 


3.1% 


Year 2 (quarters 6-9) 


94.7 


90.8 


4.0 


4.4% 


Year 3 (quarters 10-13) 


85.0 


86.5 


-1.4 


-1.6% 


Total (quarters 2-13) 


99.8 


96.8 


3.0 * 


3.1% 


Average number of months receiving 










AFDC payments 










Year 1 (quarters 2-5) 


11.41 


11.11 


0.30 


2.7% 


Year 2 (quarters 6-9) 


10.77 


10.33 


0.44 


4.2% 


Year 3 (q uarters 10-13) 


9.05 


9.85 


-0.80 


-8.1% 


Total (quarters 2-13) 


31.24 


31.29 


-0.06 


-0.2% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


99.5 


99.5 


0.0 


0.0% 


Quarter 2 


99.8 


96.8 


3.0 * 


3.1% 


Quarter 3 


94.8 


91.8 


3.0 


3.3% 


Quarter 4 


95.0 


92.8 


2.2 


2.3% 


Quarter 5 


94.6 


93.3 


1.3 


1.4% 


Quarter 6 


93.9 


89.4 


4.4 


5.0% 


Quarter 7 


94.6 


87.4 


7.2 * 


8.3% 


Quarter 8 


89.1 


85.4 


3.7 


4.3% 


Quarter 9 


86.2 


85.2 


1.0 


1.2% 


Quarter 10 


85.0 


86.5 


-1.4 


-1.6% 


Quarter 1 1 


80.1 


83.9 


—3.8 


-4.5% 


Quarter 1 2 


75.2 


80.0 


-4.8 


-6.0% 


Quarter 1 3 


67.1 


79.7 


-12.6 ** 


-15.8% 


Quarter 1 4 


— — 


— _ 


_ _ 





Quarter 15 


_ _ 


— _ 








Quarter 16 







_ 





Average total AFDC payments received ($) 










Year 1 (quarters 2-5) 


10066 


9905 


161 


1 .6% 


Year 2 (quarters 6-9) 


9071 


8889 


182 


2.1% 


Year 3 (quarters 10-13) 


7506 


7952 


-447 


-5.6% 


Total (quarters 2-13) 


26643 


26746 


-103 


-0.4% 


Average AFDC payments received ($) 










Quarter of random assignment 


2686 


2718 


-32 


-1.2% 


Quarter 2 


2655 


2511 


145 * 


5.8% 


Quarter 3 


2528 


2487 


40 


1.6% 


Quarter 4 


2480 


2488 


-8 


-0.3% 


Quarter 5 


2403 


2419 


-16 


-0.7% 


Quarter 6 


2381 


2286 


95 


4.2% 


Quarter 7 


2333 


2251 


82 


3.6% 


Quarter 8 


2209 


2193 


16 


0.7% 


Quarter 9 


2148 


2159 


-11 


-0.5% 


Quarter 10 


2110 


2126 


-16 


-0.7% 


Quarter 1 1 


1982 


2036 


-54 


-2.7% 


Quarter 12 


1779 


1926 


-147 


-7.6% 


Quarter 1 3 


1635 


1864 


-230 


-12.3% 


Quarter 14 










Quarter 15 










Quarter 16 










Sample size (total = 182) 


96 


86 







SOURCE AND NOTES: See Table 6.1 . Thirteen quarters of follow-up data are available for Alameda. 
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TABLE G.2 



BUTTE AFDC-Us: IMPACTS ON EMPLOYMENT, EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Foltow~Up Period 



Experimentais 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Year 1 (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (q uarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 16 , 



51.4 
50.4 
48.1 
67.5 



1.30 
1.37 
1.36 
4.03 



25.0 
30.2 
33.2 
33.0 
33.8 
34.2 
33.6 
34.5 
35.1 
35.1 
34.8 
33.8 
32.1 
33.6 



44.1 
45.5 
41 .9 
63.6 



1.08 
1.12 
1.13 
3.32 



18.7 
25.8 
27.9 
28.2 
25.8 
27.4 
28.3 
26.5 
29.3 
28.0 
29.8 
27.7 
27.6 
28.7 



7.3 
4.9 
6.2 
•3.8 



0.22 ** 
0.26 ** 
0.23 ** 
0.71 *** 



6.3 
4.4 
5.3 
4.8 
8.0 
6.8 
5.3 
8.0 
5.8 
7.1 
5.0 
6.0 
4.6 
4.9 



16.6% 
10.8% 
14.7% 
6.0% 



20.9% 
23.2% 
20.1% 
21 .4% 



33.5% 
17.2% 
18.8% 
IS.9% 
31.2% 
24.8% 
18.7% 
30.1% 
19.6% 
25.5% 
16.6% 
21 .8% 
16.6% 
17.0% 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average total earnings ($) 



3026 
4033 
4752 
11811 



2393 
2776 
3346 
8515 



633 * 
1257 *** 
1406 ** 
3295 *** 



26.5% 
45.3% 
42.0% 
38.7% 



Quarter of random assignment 


269 


234 


35 


14.9% 


Quarter 2 


618 


436 


182 * 


41.6% 


Quarter 3 


730 


625 


105 


16.8% 


Quarter 4 


833 


681 


152 


22.4% 


Quarter 5 


845 


651 


194 


29.8% 


Quarter 6 


903 


660 


243 * 


36.8% 


Quarter 7 


1032 


724 


308 ** 


42.6% 


Quarter 8 


1041 


696 


345 ** 


49.5% 


Quarter 9 


1057 


696 


361 ** 


51.1" : 


Quarter 10 


1144 


846 


298 * 


35.2% 


Quarter 11 


1226 


880 


345 ** 


39.2% 


Quarter 12 


1219 


834 


385 ** 


46.1% 


Quarter 13 


1164 


785 


378 ** 


48.1% 


Quarter 14 


1222 


870 


352 ** 


40.4% 


Quarter 15 










Quarter 16 











(continued) 



40 



-352- 



TABLE G.2 (continued) 



Outcome and Follow-Up Period 


Experimental 


Controls 


Difference 


Percentage 
Change 


Ever received any AFDC payments (%) 










Year 1 (quarters 2—5) 


88.5 


86.2 


2.3 


2.6% 


Tear ^ yv{Uaners o yy 


DO. 1 


no. Q 

oo.o 


— ^.^ 


o oo/ 

— O.dTO 


Year 3 (quarters 10-13) 


58.7 


60.6 


-1.9 


-3.2% 


Total (quarters 2-13) 


89.1 


87.2 


1.9 


2.2% 


Average number of months receiving 










AFDC payments 










Year 1 (quarters 2-5) 


8.34 


8.44 


-0.09 


-1.1% 


Year 2 (quarters 6-9) 


6.43 


6.78 


-0.35 


-5.1% 


Year 3 (quarters 10-13) 


5.69 


6.08 


-0.39 


-6.4% 


Total (quarters 2-13) 


20.46 


21.29 


-0.83 


-3.9% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


88.7 


88.6 


0.0 


0.1% 


Quarter 2 


87.6 


85.3 


2.3 


2.7% 


Quarter 3 


77.0 


75.8 


1.2 


1.6% 


Quarter 4 


68.8 


70.5 


-1.7 


-2.4% 


Quarter 5 


63.7 


67.0 


-3.3 


-4.9% 


Quarter 6 


60.8 


64.4 


-3.6 


-5.6% 


Quarter 7 


57.8 


60.4 


-2.7 


-4.4% 


Quarter 8 


54.9 


57.8 


-2.8 


-4.9% 


Quarter 9 


52.8 


57.6 


-4.7 


-8.2% 


Quarter 10 


52.8 


55.8 


-3.0 


-5.4% 


Quarter 1 1 


51.7 


54.7 


-3.0 


-5.5% 


Quarter 1 2 


49.3 


51.9 


-2.5 


-4.9% 


Quarter 1 3 


47.9 


52.7 


-4.8 


-9.1% 


Quarter 14 


45.9 


49.6 


-3.7 


-7.4% 


Quarter 15 


44.3 


48.3 


-4.0 


-8.2% 


Quarter 16 










Average total AFDC payments received ($) 










Year 1 (quarters 2-5) 


6523 


6749 


-226 


-3.4% 


Year 2 (quarters 6-9) 


5246 


5775 


-529 


-9.2% 


Year3 (quarters 10-13) 


4555 


5071 


-516 


-10.2% 


Total (quarters 2-13) 


16324 


17595 


-1271 


-7.2% 


Average AFDC payments received ($) 










Quarter of random assignment 


1726 


1795 


-69 


-3.9% 


Quarter 2 


1853 


1878 


-25 


-1.3% 


Quarter 3 


1688 


1706 


-18 


-1.0% 


Quarter 4 


1528 


1616 


-89 


-5.5% 


Quarter 5 


1453 


1548 


-95 


-6.1% 


Quarter 6 


1400 


1527 


-127 


-8.3% 


Quarter 7 


1336 


1483 


-147 


-9.9% 


Quarter 8 


1276 


1411 


-135 


-9.6% 


Quarter 9 


1235 


1354 


-119 


-8.8% 


Quarter 10 


1200 


1285 


-65 


-6.6% 


Quarter 1 1 


1181 


1303 


-122 


-9.4% 


Quarter 12 


1109 


1241 


-132 


-10.6^'X 


Quarter 1 3 


1065 


1243 


-178 ** 


-14.3% 


Quarter 14 


1014 


1138 


-124 


-10.9% 


Quarter 15 


961 


1041 


-80 


-7.7% 


Quarter 16 











780 



226 



ERIC 



SOURCE AND NOTES: See Table 6.1 . Fourteen quarters of employment and earnings follow-up data 
and 1 5 quarters of AFDC data are available for Butte. 
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TABLE G.3 



LOS ANGELES AFDC-Us: IMPACTS ON EMPLOYMENT, EARNINGS, 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Follow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 1 2 
Quarter 1 3 
Quarter 14 
Quarter 15 

Quarter 16 



41.2 
39.0 
35.8 
51.1 



1.24 
1.23 
1.18 
3.65 



25.1 
29.7 
30.5 
31.7 
31.9 
32.0 
30.6 
30.7 
30.0 
28.6 
29.8 
30.2 
29.5 
30.1 



29.4 
29.3 
26.0 
36.4 



0.91 
0.91 
0.83 
2.65 



23.5 
21.9 
22.8 
22.6 
23.3 
22.4 
23.0 
23.8 
22.3 
21.9 
20.9 
20.4 
19.5 
20.2 



1 1 .8 *** 

9.7 *** 

9.8 *** 
14.7 *** 



0.33 *** 
0.32 *** 
0.35 *** 
1.01 *** 



1.6 

7.8 *** 

7.8 *** 
9.1 *** 
8.7 *** 
9.6 *** 

7.6 *** 

6.9 *** 

y y *** 

6.7 *** 

8.8 *** 

9.8 *** 
10.0 ** • 

9.9 *** 



40.1% 
33.0% 
37.7% 
40.3% 



36.9% 
34.8% 
42.7% 
38.0% 



6.8% 
35.6% 
34.2% 
40.4% 
37.2% 
43.1% 
32.9% 
28.8% 
34.7% 
30.4% 
42.2% 
48.0% 
51.3% 
48.9% 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 



1480 
1787 
1726 
4993 



1221 
1468 
1417 
4106 



259 ** 
319 * 
309 
887 ** 



21.2% 
21.7% 
21.8% 
21.6% 



ERLC 



Quarter of random assignment 


242 


234 


8 




3.4% 


Quarter 2 


338 


261 


77 


** 


29.5% 


Quarter 3 


366 


312 


54 




17.4% 


Quarter 4 


383 


305 


78 


** 


25.7% 


Quarter 5 


393 


343 


50 




14.5% 


Quarter 6 


459 


366 


92 


* 


25.2% 


Quarter 7 


442 


364 


78 




21.4% 


Quarter 8 


456 


372 


83 




22.4% 


Quarter 9 


431 


365 


65 




17.9% 


Quarter 10 


405 


376 


29 




7.7% 


Quarter 1 1 


434 


354 


80 




22.6% 


Quarter 1 2 


445 


341 


104 


** 


30.4% 


Quarter 13 


442 


346 


96 


* 


27.8% 


Quarter 14 


450 


354 


96 


* 


27.1% 


Quarter 15 












Quarter 16 
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(continued) 



TABLE G.3 (continued) 



Outcome and Follow- Up Period 








Perce ntaae 


Experimentals 


Controls 


Difference 


Chanqe 


Ever received any AFDC payments (%) 










Yean (quarters 2-5) 


97.1 


97.8 


-0.7 


-0.7% 


Year 2 (quarters 6-9) 


90.9 


90.7 


0.2 


0.2% 


Years (quarters 10-13) 


84.2 


84.8 


-0.5 


-0.6% 


Total (quarters 2-13) 


97.3 


98.2 


-1.0 


-1.0% 


Average number of months receiving 










AFDC payments 










Yean (quarters 2-5) 


11.19 


11.26 


-0.07 


-0.6% 


Year 2 (quarters 6-9) 


10.43 


10.40 


0.04 


0.3% 


Year 3 (quarters 10-13) 


9.67 


9.59 


0.08 


0.9% 


Total (quarters 2-13) 


31 .29 


31.24 


0.05 


0.1% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


97.5 


97.5 


0.0 


0.0% 


Quarter 2 


96.7 


97.4 


-0.6 


-0.7% 


Quarter 3 


95.2 


95.5 


-0.3 


-0.3% 


Quarter 4 


93.7 


.93.6 


0.1 


0.1% 


Quarter 5 


91.1 


92.3 


-1.1 


-1.2% 


Quarter 6 


90.1 


89.9 


0.1 


0.2% 


Quarter 7 


88.6 


88.4 


0.2 


0.2% 


Quarter 8 


87.7 


86.5 


1.2 


1.4% 


Quarter 9 


85.5 


85.3 


0.1 


0.2% 


Quarter 10 


83.3 


84.1 


-0.8 


-1.0% 


Quarter 1 1 


82.2 


81.3 


1.0 


1 .2% 


Quarter 12 


81.6 


79.7 


1.9 


2.3% 


Quarter 13 


78.4 


77.9 


0.5 


0.6% 


Quarter 14 


77.2 


77.0 


0.2 


0.3% 


Quarter 15 


75.9 


75.8 


0.0 


0.1% 


Quarter 16 











Average total AFDC payments received ($) 










Year 1 (quarters 2-5) 


9440 


9871 


-431 *** 


-4.4% 


Year 2 (quarters 6-9) 


8333 


8826 


-493 *** 


-5.6% 


Year 3 (quarters 10-13) 


7417 


7739 


-323 * 


-4.2% 


Total (quarters 2-13) 


25190 


26436 


-1246 *** 


-4.7% 


Average AFDC payments received ($) 










Quarter of random assignment 


2558 


2565 


-7 


-0.3% 


Quarter 2 


2503 


2552 


—49 *** 


-1.9% 


Quarter 3 


2406 


2506 


-100 *** 


-4.0% 


Quarter 4 


2327 


2451 


—124 *** 


-5.1% 


Quarter 5 


2205 


2361 


-157 *** 


-6.6% 


Quarter 6 


2171 


2299 


-128 *** 


-5.6% 


Quarter 7 


2119 


2251 


-133 *** 


-5.9% 


Quarter 8 


2066 


2177 " 


-111 ** 


-5.1% 


Quarter 9 


1978 


2099 


-121 *** 


-5.8% 


Quarter 10 


1915 


2045 


-130 *** 


-6 4% 


Quarter 1 1 


1899 


1970 


-71 


-3.6% 


9uarter 12 


1844 


1900 


-56 


-3.0% 


Quarter 13 


1759 


1824 


-65 


-3.6% 


Quarter 14 


1715 


1751 


-36 


-2.1% 


Quarter 15 


1667 


1708 ■ 


-41 


-2.4% 


Quarter 16 










Sample size (total = 1458) 


735 


723 







SOURCE AND NOTES: See Table 6.1 . Fourteen quarters of employment and earnings follow-up data and 
15 quarters of AFDC data are available for Los Angeles. 
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TABLE G.4 



RIVERSIDE AFDC-Us: IMPACTS ON EMPLOYMENT. EARNINGS. 
AFDC RECEIPT. AND AFDC PAYMENTS 



Outcome and Foliow~Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Yean (quarters 2-5) 
Year 2 (quarters 6-9) 
Year3 (quarters 10-13) 
Total (quarters i2-13) 

Average number of quarters with 
employment 

Yean (quarters 2-5) 

Year 2 (quarters 6 -9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 1 6 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 



57.2 
51.3 
44.8 
69.1 



48.6 
44.7 
40.2 
61.3 



8.6 *** 
6.6 *** 
4.6 ** 
7.8 *** 



17.7% 
14.8% 
1 1 .3% 
12.7% 



1.51 


1.24 


0.27 *** 


21.9% 


1.42 


1.23 


0.19 *** 


15.4% 


1.30 


1.15 


0.15 ** 


1 2.9% 


4.22 


3.62 


0.61 *** 


16.8% 


28.9 


23.0 


5.9 *** 


25.5% 


37.5 


27.4 


10.2 *** 


37.2% 


38.8 


31.7 


-J ^ *** 


22.4% 


39.3 


33.8 


5.5 *** 


16.2% 


35.7 


31 .2 


4.4 ** 


14.1% 


37.7 


31.1 


6.6 *** 


21.1% 


36.0 


31 .1 


4.9 ** 


15.6% 


34.7 


30.9 


3.7 * 


1 2.0% 


33.3 


29.5 


3.7 * 


12.7% 


32.8 


28.5. 


4.2 ** 


14.7% 


33.6 


28.5 


5.1 ** 


17.7% 


32.1 


29.2 


2.9 


9.8% 


31.1 


28.5 


2.6 


9.3% 


30.2 


26.3 


3.8 * 


14.6% 










3691 


2930 


761 *** 


26.0% 


4038 


3C28 


411 


11.3% 


3812 


3478 


334 


9.6% 


11542 


10036 


1506 ** 


15.0% 



Quarter of random assignment 


326 


Quarter 2 


725 


Quarter 3 


970 


Quarter 4 


1016 


Quarter 5 


981 


Quarter 6 


1051 


Quarter 7 


1029 


Quarter 8 


1012 


Quarter 9 


946 


Quarter 10 


986 


Quarter 1 1 


963 


Quarter 12 


961 


Quarter 13 


902 


Quarter 14 


962 


Quarter 15 




Quarter 16 





223 
492 
690 
867 
881 
928 
929 
916 
855 
832 
879 
891 
876 
866 



104 *** 
232 *** 
280 *** 
149 * 
100 
123 
100 

96 

92 
154 * 

84 

70 

26 

97 



46.5% 
47.2% 
40.5% 
17.1% 
11.4% 
13.3% 
10.7% 
10.5% 
10.7% 
18.5% 
9.6% 
7.9% 
3.0% 
1 1 .2% 



(continued) 
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TABLE G.4 (continued) 



vjuicorne anu roiiow— up r6noa 


Experimental 


Controls 


Difference 




Percentage 
Change 


Ever received anv AFHC navmpnt^ {9/n.\ 












Year 1 (quarters 2—5) 


84.1 


86.7 


— P 7 


* 


— 0.1 /© 


Year 2 (quarters 6-9) 


59.5 


62.3 


-2.8 




—4.5% 


Years (quarters 10-13) 


53.1 


51.9 


1.2 




2.3% 


lotai (quarters 2—13) 


88.1 


90.4 


-2.2 




-2.5% 


Average number of months receiving 












AFDC payments 












Yean (quarters 2-5) 


6.48 


7.37 


-0.90 


*** 


-12.2% 


Year 2 (quarters 6-9) 


5.21 


5.70 


-0.49 


** 


-8.6% 


Year 3 (quarters 10-13) 


4.93 


5.08 


-0.15 




-2.9% 


Total (quarters 2-13) 


16.61 


18.15 


-1.54 


*** 


-8.5% 


Ever received any AFDC payments (%) 












Quarter of random assignment 


88.2 


88.3 


-0.1 




-0.1% 


Quarter 2 


78.7 


84.2 


-5.4 


*** 


-6.4% 


Quarter 3 


59.3 


68.6 


-9.3 


*** 


-13.6% 


Quarter 4 


55.7 


60.5 


-4.7 




-7.8% 


Quarter 5 


51.1 


56.9 


-5.8 




-10.2% 


Quarter 6 


48.4 


54.3 


-5.8 


*** 


-10.8% 


Quarter 7 


48.2 


50.9 


-"2.7 




-5.3% 


Quarter 8 


47.3 


49.6 


-2.3 




-4.7% 


Quarter 9 


46.9 


49.5 


-2.6 




-5.3% 


Quarter 10 


45.9 


48.3 


-2.4 




-4.9% 


Quarter 1 1 


44.9 


44.8 


0:2 




0.3% 


Quarter 1 2 


43.0 


44.0 


-1.0 




-2.3% 


Quarter 13 


42.6 


40.9 


1.7 




4.1% 


Quarter 14 


42.2 


40.8 


1.4 




3.5% 


Quarter 1 5 




AO n 


U.o 




r\ ~7o/ 


Quarter 16 












Average total AFDC payments received ($) 












Yean (quarters 2-5) 


4840 


5807 


-967 


*** 


-16.7% 


Year 2 (quarters 6-9) 


3892 


4640 


-748 


*** 


-16.1% 


Year 3 (quarters 10-13) 


3614 


3964 


-350 


* 


-8.8% 


Total (quarters 2-13) 


12346 


14411 


-2064 


*** 


-14.3% 


Average AFDC payments received ($) 












Quarter of random assignment 


1679 


1734 


-54 




-3.1% 


Quarter 2 


1539 


1765 


-226 


*** 


-12.8% 


Quarter 3 


1169 


1465 


-296 


*** 


-20.2% 


Quarter 4 


1100 


1328 


-228 


*** 


-17.1% 


Quarter 5 


1031 


1248 


-217 


*** 


-17.4% 


Quarter 5 


995 


1234 


-239 


*** 


-19.4% 


Quarter 7 


992 


1171 


-179 


*** 


-15.3% 


Quarter 8 


949 


1135 


-186 


*** 


-16.4% 


Quarter 9 


957 


1100 


-144 


*** 


-13.0% 


Quarter 1 0 


956 


1074 


-118 




-11.0% 


Quarter 1 1 


916 


1034 


-118 


** 


-11.4% 


Quarter 1 2 


878 


966 


-88 


* 


-9.1% 


Quarter 13 


864 


891 


-27 




-3.0% 


Quarter 14 


858 


869 


-11 




-1.3% 


Quarter 1 5 


838 


863 


-25 




-2.9% 


Quarter 16 












Sample size (total = 2323) 


1590 


733 









SOURCE AND NOTES: See Table 6.1 . Fourteen quarters of employment and earnings follow-up data and 
15 quarters of AFDC data are available for Riverside, 
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TABLE G.5 



SAN DIEGO AFDC-Us: IMPACTS ON EMPLOYMENT. EARNINGS. 
AFDC RECEIPT. AND AmC PAYMENTS 



Outcome and Foltow-Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Yean (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Yearl (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 1 6 



Average total earnings ($) 
Year 1 (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average total earnings ($) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 15 

Quarter 1 6 



53.9 


50.1 


3.8 ** 


7.6% 


50.0 


45.8 


4.2 ** 


9.1% 


45.6 


43.9 


1.7 


3.9% 


67.3 


64.6 


2.7 


4.1% 


1.49 


1.38 


0.10 


7.3% 


1.48 


1.34 


0.14 ** 


10.4% 


1.38 


1.35 


0.02 


1.8% 


4.34 


4.08 


0.26 


6.5% 


32.9 


33.4 


-0.5 


-1.4% 


35.2 


33.5 


1.7 


5.0% 


37.8 


35.7 


2.1 


6.0% 


38.1 


34.6 


3.5 * 


10.0% 


37.5 


34.6 


2.8 


8.2% 


37.9 


34.3 


3.6 * 


10.5% 


37.5 


33.8 


3.6 * 


10.7% 


36.7 


32.8 


4.0 ** 


12.1% 


35.7 


33.0 


2.7 


8.2% 


34.9 


33.6 


1.3 


3.9% 


34.2 


33.4 


0.8 


2.3% 


34.0 


34.2 


-0.2 


-0.6% 


34.6 


34.0 


0.6 


1 .6% 


33.5 


32.7 


0.8 


2.4% 


32.7 


33.0 


-0.3 


-1.0% 


31.2 


32.5 


-1.3 


-4.0% 


3331 


3089 


242 


7.8% 


4128 


3978 


150 


3.8% 


4144 


4402 


-258 


-5.9% 


11603 


11469 


134 


1.2% 


377 


• 

399 


-22 


-5.6% 


624 


560 


64 


1 1 .5% 


829 


752 


73 


10.3% 


914 


879 


35 


4.0% 


964 


899 


65 


7.3% 


1034 


966 


68 


7.0% 


1034 


985 


49 


4.9% 


1028 


1000 


29 


2.9% 


1031 


1027 


5 


0.4% 


1036 


1077 


-41 


-3.8% 


1023 


1124 


-101 


-9.0% 


1056 


1114 


-58 


-5.2% 


1029 


1087 


-58 


-5.3% 


1026 


1090 


-64 


-5.9% 


1001 


1091 


-89 


-8.2% 


1012 


1056 


-44 


-4.2% 



(continued) 
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TABLE G.5 (continued) 



Outcome and Foltow— Up Period 








Percentage 


Experimentais 


Controls 


Difference 


Change 


ever receivea any Mruo paymenis y76) 










Year 1 ^auarters 2—5^ 


OA Q 


OA n 


1 .U 


■i r\o/ 
1 .Uto 


Year 2 (quarters 6— 9) 


71 .4 


74 A 




— H.U /o 


Year 3 (quarters 10-13) 


64.8 


63.5 


1.3 


2.0% 


Total (quarters 2-13) 


96.1 


• 94.7 


1.4 


1 .4% 


Average number of months receiving 










AFDC payments 










Yearl (quarters 2-5) 


8.97 


9.40 


-0.44 *** 


-4.6% 


Year 2 (quarters 6-9) 


7.29 


7.80 


-0.51 ** 


-6.6% 


Years (quarters 10-13) 


6.83 


6.88 


-0.05 


-0.7% 


Total (quarters 2-13) 


23.09 


24.08 


-1.00 * 


-4.1% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


98.0 


98.3 


-0.3 


-0.3% 


Quarter 2 


93.7 


92.9 


0.8 


0.9% 


Quarter 3 


81.1 


83.6 


-2.5 


-3.0% 


Quarter 4 


73.6 


79.0 


-5 4 *** 


-6.8% 


Quarters 


69.4 


74.6 


-5.2 *** 


-7.0% 


Quarter 6 


65.2 


71.0 


-5.7 *** 


-8.1% 


Quarter 7 


63.7 


68.4 


-4.7 ** 


-6.9% 


Quarter 8 


63.3 


65.9 


-2.5 


-3.8% 


Quarter 9 


61.8 


64.0 


-2.2 


-3.5% 


Quarter 10 


60.7 


61.3 


-0.6 


-1.0% 


Quarter 1 1 


59.8 


58.7 


1.0 


1.7% 


Quarter 1 2 


58.6 


58.0 


0.6 


1.0% 


Quarter 13 


56.9 


57.2 


-0.2 


-0.4% 


Quarter 1 4 


55.2 


56.1 


-0.9 


-1.6% 


Oi torpor 1 ^ 






—0.8 


— 1.4% 


Quarter 16 


53.0 


53.5 


-0.5 


-1.0% 


Average total AFDC payments received ($) 










Yearl (quarters 2-5) 


6790 


7301 


-510 *** 


-7.0% 


Year 2 (quarters 6-9) 


5565 


6197 


-632 *** 


-10.2% 


Years (quarters 10-13) 


5155 


5339 


-184 


-3.4% 


Total (quarters 2-13) 


17510 


18837 


-1327 *** 


-7.0% 


Average AFDC payments received ($) 










Quarter of random assignment 


1871 


1892 


-21 


-1.1% 


Quarter 2 


1936 


1990 


-54 * 


-2.7% 


Quarter 3 


1720 


1862 


—142 *** 


-7.6% 


Quarter 4 


1614 


1755 


— ^4-1 *** 


-8.0% 


Quarters 


1520 


1694 


—174 *** 


-10.2% 


Quarter 6 


1435 


1631 


-196 *** 


-12.0% 


Quarter 7 


1395 


1574 


-180 *** 


-11.4% 


Quarter 8 


1381 


1517 


-137 *** 


-9.0% 


Quarter 9 


1354 


1474 


-120 ** 


-8.1% 


Quarter 10 


1339 


1419 


-80 * 


-5.6% 


Quarter 1 1 


1304 


1350 


-47 


-3.4% 


Quarter 1 2 


1277 


1301 


-24 


-1.9% 


Quarter 13 


1235 


1268 


-33 


-2.6% 


Quarter 1 4 


1183 


1224 


-41 


-3.3% 


Quarter 15 


1138 


1171 


-33 


-2.8% 


Quarter 16 


1104 


1138 


-35 


-3.0% 


Sample size (total = 3272) 


2427 


845 







SOURCE AND NOTES: See Table 6.1 . Sixteen quarters of follow-up data are available for San Diego. 
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TABLE G.6 

TULARE AFDC-Us: IMPACTS ON EMPLOYMENT, EARNINGS. 
AFDC RECEIPT, AND AFDC PAYMENTS 



Outcome and Follow~Up Period 



Experimentals 



Controls 



Difference 



Percentage 
Change 



Ever employed (%) 
Yean (quarters 2-5) 
Year 2 (quarters 6-9) 
Years (quarters 10-13) 
Total (quarters 2-13) 

Average number of quarters with 
employment 

Year 1 (quarters 2-5) 

Year 2 (quarters 6-9) 

Year 3 (quarters 10-13) 

Total (quarters 2-13) 

Ever employed (%) 
Quarter of random assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 
Quarter 8 
Quarter 9 
Quarter 10 
Quarter 1 1 
Quarter 12 
Quarter 13 
Quarter 14 
Quarter 1 5 

Quarter 16 



52.5 
50.2 
48.9 
67.0 



1.38 
1.41 
1.42 
4.21 



30.3 
32.2 
36.4 
34.7 
34.6 
36.1 
37.6 
34.9 
32.2 
34.1 
36.6 
36.5 
35.2 



51.2 
48.9 
48.4 
64.0 



1.38 
1.39 
1.37 
4.14 



31.8 
31.6 
35.1 
36.9 
34.6 
37.5 
37.5 
33.6 
30.7 
34.9 
35.8 
33.5 
32.6 



1.3 
1.3 
0.5 
3.0 



-0.00 
0.01 
0.06 
0.07 



-1.5 
0.6 
1.2 

-2.2 
0.0 

-1.4 
0.1 
1.3 
1.5 

-0.8 
0.8 
3.0 
2.5 



2.5% 
2.6% 
1 .0% 
4.7% 



-0.3% 
1 .0% 
4.1% 
1 .6% 



-4.8% 
2.0% 
3.5% 

-5.9% 
0.0% 

-3.8% 
0.3% 
3.9% 
4.8% 

-2.2% 
2.2% 
8.9% 
7.8% 



Average total earnings {$) 
Yearl (quarters 2-5) 
Year 2 (quarters 6-9) 
Year 3 (quarters 10-13) 
Total (quarters 2-13) 

Average total earnings ($) 



2987 
3721 
4121 
10829 



Quarter of random assignment 


345 


Quarter 2 


561 


Quarter 3 


786 


Quarter 4 


823 


Quarter 5 


817 


Quarter 6 


910 


Quarter 7 


999 


Quarter 8 


956 


Quarter 9 


856 


Quarter 10 


973 


Quarter 1 1 


1066 


Quarter 12 


1084 


Quarter 1 3 


998 


Quarter 14 




Quarter 15 




Quarter 16 





2961 
3998 
4138 
11097 



373 
639 
767 
776 
779 
980 
1033 
1026 
959 
1050 
1093 
1032 
963 



26 
-277 
-17 
-268 



«28 
-78 
19 
47 
38 
-70 
-34 
-70 
-102 
-77 
-27 
52 
35 



0.9% 
-6.9% 
-0.4% 
-2.4% 



-7.5% 
-12.1% 
2.5% 
6.0% 
4.8% 
-7.2% 
-3.3% 
-6.8% 
-10.7% 
-7.3% 
-2.4% 
5.0% 
3.6% 



(continued) 
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TABLE Q.6 (continued) 



Outcome and Follow— Up Period 


Experimentals 


Controls 


Difference 


Percentage 
Change 


Pvpr rpppivpH anu APnr* navmpntc (9jL\ 
E.v^i icv/dv^^vi cany r\riy\^ |Jciyi I ici lis \/0f 










Year 1 (quarters 2—5) 


94.3 




•1 7 
1 .1 


^ 00/ 

1 .8% 


Year 2 (quarters 6-9) 


76.5 


75.7 


0.8 


1 . 1 A) 


Year 3 (quarters 10-13) 


69.7 


67.5 


2.3 


3.3% 


Total (quarters 2— 13) 


95.2 


95.0 


0.2 


0.2% 


Average number of months receiving 










AFDC payments 










Yearl (quarters 2-5) 


9.33 


9.14 


0.20 


2.1% 


Year 2 (quarters 6-9) 


7.81 


7.61 


0.20 


2.7% 


Year3 (quarters 10-13) 


7.18 


6.93 


0.25 


3.5% 


Total (quarters 2-13) 


24.32 


23.68 


0.64 


2.7% 


Ever received any AFDC payments (%) 










Quarter of random assignment 


94.8 


95.7 


-0.9 


-1 .0% 


Quarter 2 


92.8 


90.9 


1.8 


2.0% 


Quarter 3 


84.4 


80.2 


4.2 ** 


5.3% 


Quarter 4 


77.8 


76.0 


1.8 


2.4% 


Quarter 5 


74.6 


74.5 


0.2 


0.2% 


Quarter 6 


70.6 


69.8 


0.8 


1.1% 


Quarter 7 


68.3 


66.8 


1.5 


2.3% 


Quarter 8 


66.6 


65.0 


1.6 


2.5% 


Quarter 9 


66.4 


65.3 


1.1 


1 .7% 


Quarter 10 


64.8 


62.8 


2.0 


3.2% 


Quarter 1 1 


63.5 


59.6 


3.9 * 


6.5% 


Quarter 12 


62.1 


59.5 


2.6 


4.4% 


Quarter 13 


60.4 


59.9 


0.5 


0.9% 


Quarter 14 










Quarter 1 5 










Quarter 1 6 











Average total AFDC payments received ($) 



Year 1 (quarters 2-5) 


7545 


7523 


23 ■ 


0.3% 


Year 2 (quarters 6-9) 


6316 


6261 


54 


0.9% 


Year 3 (quarters 10-13) 


5588 


5600 


-12 


-0.2% 


Total (quarters 2-13) 


19449 


19384 


66 


0.3% 


average AFDC payments received ($) 










Quarter of random assignment 


1916 


1997 


-8-1 *** 


-4.1% 


Quarter 2 


2059 


2054 


5 


0.3% 


Quarter 3 


1927 


1898 


29 


1.5% 


Quarter 4 


1805 


1813 


-8 


-0.4% 


Quarter 5 


1754 


1757 


-3 


-0.2% 


Quarter 6 


1657 


1638 


19 


1.1% 


Quarter 7 


1586 


1563 


23 


1 .5% 


Quarter 8 


1542 


1540 


2 


0.1% 


Quarter 9 


1530 


1520 


10 


0.7% 


Quarter 10 


1486 


1475 


11 


0.7% 


Quarter 1 1 


1419 


1396 


23 


1.7% 


Quarter 1 2 


1359 


1360 


-1 


-0.1% 


Quarter 13 


1324 


1369 


-45 


-3.3% 


Quarter 14 










Quarter 1 5 










Quarter 1 6 











Sample size (total = 1901) 1319 582 



SOURCE AND NOTES: See Table 6.1 . Thirteen quarters of follow-up data are available for Tulare. 




REFERENCES 



Cave, George; and Doolittle, Fred. 1991. Assessing JOBSTART: Interim Impacts of a Program for School 
Dropouts, New York: Manpower Demonstration Research Corporation. 

Freedman, Stephen; and Riccio, James. 1991. GAIN: Participation Patterns in Four Counties. New York: 
Manpower Demonstration Research Corporation. 

Friedlander, Daniel. 1987. Maryland: Supplemental Report on the Baltimore Options Program. New York: 
Manpower Demonstration Research Corporation. 

Friedlander, Daniel. 1988. Subgroup Impacts and Performance Indicators for Selected Welfare Employment 
Programs. New York: Manpower Demonstration Research Corporation. 

Friedlander, Daniel. 1994. The Impacts of California 's GAIN Program on Different Ethnic Groups: Two-Year 
Findings on Earnings and AFDC Payments. Working Paper. New York: Manpower Demonstration 
Research Corporation. 

Friedlander, Daniel; and Burtless, Gary. Forthcoming. Five Years After: The Long-Term Effects of Welfare-to- 
Work Programs. New York: Russell Sage Foundation. 

Friedlander, Daniel; and Goldman, Barbara. 1988. Employment and Welfare Impacts of the Arkansas WORK 
Program: A Three-Year Follow-up Study in Two Counties. New York: Manpower Demonstration 
Research Corporation. 

Friedlander, Daniel; and Gueron, Judith M. 1992. "Are High-Cost Services More Effective than Low-Cost 
Services?" In Evaluating Welfare and Training Programs, ed. C. F. Manski and I. Garfmkel, 143-98. 
Cambridge: Harvard University Press. 

Friedlander, Daniel; and Hamilton, Gayle. 1993. The Saturation Work Initiative Model in San Diego: A Five- 
Year Follow-up Study. Nev/ York: Manpower Demonstration Research Corporation. 

Friedlander, Daniel; Hoerz, Gregory; Quint, Janet; and Riccio, James. 1985. Arkansas: Final Report on the 
WORK Program in Two Counties. New York: Manpower Demonstration Research Corporation. 

Friedlander, Daniel; Riccio, James; and Freedman, Stephen. 1993. GAIN: Two-Year Impacts in Six Counties, 
New York: Manpower Demonstration Research Corporation. 

Gueron, Judith; and Pauly, Edward, 1991. From Welfare to Work. New York: Russell Sage Foundation. 

Hagen, Jan L.; and Lurie, Irene, 1992. Implementing JOBS: Initial State Choices. Albany, N.Y.: Nelson A. 
Rockefeller Institute of Government, State University of New York. 

Kemple, James J.; and Haimson, Joshua. 1994. Florida's Project Independence: Program Implementation, 
Participation Patterns, and First-Year Impacts. New York: Manpower Demonstration Research 
Corporation. 

Lx)ng, David: and Knox, Virginia. 1985. Documentation of the Data Sources and Analytical Methods Used 
in the Benefit-Cost Analysis of the EPP/EWEP Program in San Diego. New York: Manpower 
Demonstration Research Corporation. 



-362- 



Lurie, Irene; and Hagen, Jan L. 1993. Implementing JOBS: Vie Initial Design and Structure of Local 
Programs, Albany, N.Y.: Nelson A. Rockefeller Institute of Government, State University of New 
York. 

Martinson, Karin; and Friedlander, Daniel. 1994. GAIN: Basic Education in a Welfare-to-Work Program, New 
York: Manpower Demonstration Research Corporation. 

Martinson, Karin; and Riccio, James. 1989. GAIN: Child Care in a Welfare Employment Initiative. New 
York: Manpower Demonstration Research Corporation. 

Masters, Stanley H.; and Maynard, Rebecca. 1981. The Impact of Supported Work on Long-Term Recipients 
of AFDC Benefits. Vol. 3 of the Final Report on the Supported Work Demonstration. New York: 
Manpower Demonstration Research Corporation. 

Mayer, Susan E.; and Jencks, Christopher. 1989. "Poverty and the Distribution of Material Hardship." 
Journal of Human Resources 24(1): 88-113. 

Orr, Larry L. ; Bloom, Howard S. ; Bell, Stephen H. ; Lin, Winston; Cave, George; and Doolittle, Fred. 1994. 
The National JTPA Study: Impacts, Benefits, and Costs of Title II-A. Bethesda, Md. : Abt Associates Inc. 

Riccio, James; and Friedlander, Daniel. 1992. GAIN: Program Strategies, Participation Patterns, and First- 
Year Impacts in Six Counties. New York: Manpower Demonstration Research Corporation. 

Riccio, James; Goldman, Barbara; Hamilton, Gayle; Martinson, Karin; and Orenstein, Alan. 1989. GAIN: 
Early Implementation Experiences and Lessons. New York: Manpower Demonstration Research 
Corporation. 

Riverside County Department of Public Social Services. 1992. The GAIN Sanctions in Riverside County. 
Riverside, Calif.: Riverside County Department of Public Social Services. 

Scholz, John K. 1994. "Tax Policy and the Working Poor: The Earned Income Tax Credit. ' IRP Focus 15 
(3): M2. 

U.S. Bureau of the Census. 1993. Statistical Abstract of the United States, 1993 (113th edition). Washington, 
D.C.: U.S. Bureau of the Census. 

U.S. Congress, House Committee on Ways and Means. 1993. Overview of Entitlement Programs. 
Washington, D.C.: U.S. Government Printing Office. 

U.S. Department of Health and Human Services. 1994. Aid to Families with Dependent Children (AFDC) 
Information Memorandum, no. ACF-IM-94-1, March 14, 1994. Washington, D.C.: U.S. Department 
of Health and Human Services. 

Wallace, John; and Long, David. 1987. GAIN: Planning and Early Implementation. New York: Manpower 
Demonstration Research Corporation. 

Wolfhagen, Carl; and Goldman, Barbara. 1983. Job Search Strategies: Lessons from the Louisville WIN 
Laboratory. New York: Manpower Demonstration Research Corporation. 



-363- 



SELECTED MDRC PUBLICATIONS 



WELFARE-TOWORK PROGRAMS 

From Welfare to Work (Russell Sage Foundation). Book. 1991. Judith M. Gueron, Edward Pauly. A synthesis 
of research findings on the effectiveness of welfare-to-work programs. Chapter 1, which is the summary 
of the book, is also published separately by MDRC. 

Reforming Welfare with Work (Ford Foundation). Monograph. 1987. Judith M. Gueron. A review of welfare-to- 
work initiatives in five states. 

Working Papers 

Child Support Enforcement: A Case Study. 1993. Dan Bloom. 

Learning from the Voices of Mothers: Single Mothers' Perceptions of the Trade-offs Between Welfare and Work, 
1993. LaDonna Pavetti. 

Unpaid Work Experience for Welfare Recipients: Findings and Lessons from MDRC Research, 1993, Thomas 

Brock, David Butler, David Long. 
The Impacts of California's GAIN Program on Different Ethnic Groups: Two-Year Findings on Earnings and 

AFDC Payments, 1994. Daniel Friedlander. 

Papers for Practitioners 

Assessing JOBS Participants: Issues and Trade-offs. 1992. Patricia Auspos, Kay Sherwood. 
Linking Welfare and Education: A Study of New Programs in Five States. 1992. Edward Pauly, David Long, 
Karin Martinson. 

Improving the Productivity of JOBS Programs, 1993. Eugene Bardach. 
The GAIN Evaluation 

An evaluation of California's Greater Avenues for Independence (GAIN) Program, which is currently 
operating as the state's JOBS program and features upfront basic education as well as job search and 
other activities. 

GAIN: Planning and Early Implementation. 1987. John Wallace, David Long. 

GAIN: Child Care in a Welfare Employment Initiative. 1989. Karin Martinson, James Riccio. 

GAIN: Early Implementation Experiences and Lessons. 1989. James Riccio, Barbara Goldman, Gayle Hamilton, 

Karin Martinson, Alan Orenstein. 
GAIN: Participation Patterns in Four Counties. 1991. Stephen Freedman, James Riccio. 
GAIN: Program Strategies, Participation Patterns, and First-Year Impacts in Six Counties. 1992. James Riccio, 

Daniel Friedlander. 

GAIN: Two-Year Impacts in Six Counties. 1993. Daniel Friedlander, James Riccio, Stephen Freedman. 
GAIN: Basic Education in a V/elfare-to-Work Program. 1994. Karin Martinson, Daniel Friedlander. 

Related Study: 

The Impacts of California's GAIN Program on Different Ethnic Groups: Two-Year Findings on Earnings and 
AFDC Payments, Working Paper. 1994. Daniel Friedlander. 

The JOBS Evaluation 

An evaluation of welfare-to-work programs operating under the Job Opportunities and Basic Skills 
Training (JOBS) provisions of the Family Support Act of 1988. 

From Welfare to Work (Russell Sage Foundation). Book. 1991. Judith M. Gueron, Edward Pauly. See 
description above. 



-364- 



The Evaluation of Florida's Project Independence 

An evaluation of Florida's JOBS program. 

Florida's Project Independence: Program Impiementaxion, Participation Patterns, and First-Year Impacts. 1994. 
James Kemple, Joshua Haimson. 

The Saturation Work Initiative Model (SWIM) 

A test of the feasibility and effectiveness of an ongoing participation requirement in a welfare-to-work 
program. 

Interim Report on the Saturation Work Initiative Model in San Diego, 1988. Gayle Hamilton. 
Final Report on the Saturation Work Initiative Model in San Diego. 1989. Gayle Hamilton, Daniel Friedlander. 
The Saturation Work Initiative Model in San Diego: A Five-Year Follow-up Study. 1993. Daniel Friedlander, 
Gayle Hamilton. 

The Demonstration of State Work/Welfare Initiatives 

A test of the feasibility and effectiveness of various state employment initiatives for welfare recipients. 

Arizona: Preliminary Managemeru Lessons from the WIN Demonstration Program. 1984. Kay Sherwood. 

Arkansas: Interim Findings from the Arkansas WIN Demonstration Program. 1984. Janet Quint. 
Final Report on the WORK Program in Two Counties. 1985, Daniel Friedlander, Gregory Hoerz, Janet 
Quint, James Riccio. 

California: Preliminary Findings from the San Diego Job Search and Work Experience Demonstration. 1984. 

Barbara Goldman, Judith Gueron, Joseph Ball, Marilyn Price. 
Findings from the San Diego Job Search and Work Experience Demonstration. 1985. Barbara Goldman, 

Daniel Friedlander, Judith Gueron, David Long. 
Final Report on the San Diego Job Search and Work Experience Demonstration. 1986. Barbara Goldman, 

Daniel Friedlander, David Long. 

niinois: Interim Findings from the WIN Demonstration Program in Cook County. 1986. Janet Quint, Cynthia 
Guy. 

Final Report on Job Search atid Work Experience in Cook County. 1987. Daniel Friedlander, Stephen 
Freedman, Gayle Hamilton, Janet Quint. 

Maine: Interim Findings from a Grant Diversion Program. 19S5 . Patricia Auspos. 
Final Report on the Training Opportunities in the Private Sector Program. 1988. Patricia Auspos, George 
Cave, David Long. 

Maryland: Interim Findings from the Maryland Employment Initiatives Programs. 1984. Janet Quint. 
Final Report on the Employment Initiatives Evaluation. 1985. Daniel Friedlander, Gregory Hoerz, David 
Long, Janet Quint. 

Supplemental Report on the Baltimore Options Program. 1987. Daniel Friedlander. 

New Jersey: Final Report on the Grant Diversion Project. 1988. Stephen Freedman, Jan Bryant, George 
Cave. 

Virginia: Interim Findings from the Virginia Employment Services Program. 1985. Marilyn Price. 
Final Report on the Virginia Employment Services Program. 1986. James Riccio, George Cave, Stephen 
Freedman, Marilyn Price. 

West Virginia: Interim Findings on the Community Work Experience Demonstrations. 1984. Joseph Ball. 
Final Report on the Community Work Experience Demonstrations. 1986. Daniel Friedlander, Marjorie 
Erickson, Gayle Hamilton, Virginia Knox. 

Other Reports on the Demonstration of State Work/Welfare Initiatives 

Documentation of the Data Sources and Analytical Methods Used in the Benefit-Cost Analysis of the EPP/EWEP 
Program in San Diego. 1985. David Long, Virginia Knox. 

-365- 



510 



Relationship Between Earnings and Welfare Benefits for Working Recipients: Four Area Case Studies, 1985, 
Barbara Goldman, Edward Cavin, Maijorie Erickson, Gayle Hannlton, Darlene Hasselbring, Sandra 
Reynolds. 

Welfare Grant Diversion: Early Observations from Programs in Six States, 1985. Michael Bangser, James 
Healy, Robert Ivry. 

A Survey of Participants and Worksite Supervisors in the New York City Work Experience Program, 1986, 

Gregory Hoerz, Karla Hanson. 
Welfare Grant Diversion: Lessons and Prospects. 1986. Michael Bangser, James Healy, Roben Ivry. 
Work Initiatives for Welfare Recipients: Lessons from a Multi-State Experiment, 1986, Judith Gueron, 

The Subgroup/Performance Indicator Study 

A study of the impacts of selected welfare-to-work programs on subgroups of the AFDC caseload. 

A Study of Performance Measures and Subgroup Impaas in Three Welfare Employment Programs, 1987. Daniel 
Friedlander, David Long. 

Subgroup Impacts and Performance Indicators for Seleaed Welfare Employment Programs, 1988. Daniel 
Friedlander. 

The Self-Employment Investment Demonstration (SEED) 

A test of the feasibility of operating a program to encourage self-employment among recipients of AFDC. 

Self-Employment for Welfare Recipients: Implementation of the SEID Program, 1991. Cynthia Guy, Fred 
Doolittle, Barbara Fink. 

The WIN Research Laboratory Project 

A test of innovative service delivery approaches in four Work Incentive Program (WIN) offices. 

Immediate Job Search Assistance: Preliminary Results from the Louisville WIN Research Laboratory Project, 

1980. Barbara Goldman. 
Preliminary Research Findings: WIN Research Laboratory Project, 1980. MDRC. 

Final Report on WIN Services to Volunteers: Denver WIN Research Laboratory Projea, 1981. Ellen Slaughter, 

Paulette Turshak, Gale Whiteneck, Edward Baumhcier, 
Impacts of the Immediate Job Search Assistance Experiment: Louisville WIN Research Laboratory Project, 1981. 

Barbara Goldman. 

The Workings of WIN: A Field Observation Study of Three Local Offices, 1981. Sydelle Levy. 

Welfare Women in a Group Job Search Program: Their Experiences in the Louisville WIN Research Laboratory 

Project, 1982. Joanna Gould-Stuart, 
772^ WIN Labs: A Federal/Local Partnership in Social Research, 1982. Joan Leiman, 

Job Search Strategies: Lessons from the Louisville WIN Laboratory, 1983, Carl Wolfhagen, Barbara Goldman. 



PROGRAMS FOR TEENAGE PARENTS ON WELFARE 
The LEAP Evaluation 

An evaluation of Ohio's Learning, Earning, and Parenting (LEAP) Program, which uses fmancial incentives 
to encourage teenage parents on welfare to stay in or return to school, 

LEAP: Implementing a Welfare Initiative to Improve School Attendance Among Teenage Parents, 1991. Dan 

Bloom, Hilary Kopp, David Long, Denise Polit. 
LEAP: Interim Findings on a Welfare Initiative to Improve School Attendance Among Teenage Parents, 1993. 

Dan Bloom, Veronica Fellerath, David Long, Robert Wood, 

The New Chance Demonstration 

A test of a cc nprehensive program of services that seeks to improve the economic status and general well- 
being of a group of highly disadvantaged young women and their children. 
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About MDRC 

The Manpower Demonstration Research Corporation (MDRC) is a 
nonprofit social policy research organization founded in 1974 and 
located in New York City and San Francisco. Its mission is to design 
and rigorously field-test promising education and employment-related 
programs aimed at improving the well-being of disadvantaged adults 
and youth, and to provide policymakers and practitioners with reliable 
evidence on the effectiveness of social programs. Through this work, 
and its technical assistance to program administrators, MDRC seeks to 
enhance the quality of public policies and programs. MDRC actively 
disseminates the results of its research through its publications and 
through interchange with policymakers, administrators, practitioners, 
and the public. 

Over the past two decades - working in partnership with more than 
forty states, the federal government, scores of communities, and 
numerous private philanthropies - MDRC has developed and studied 
more than three dozen promising social policy initiatives. 
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